Network Error, connection timed out error

I received this error message while trying to remotely connect to one of my Linux server. I used PuTTy.exe to establish a connection between host and server. When I enter the IP address of the Linux server machine and click on connect, it takes sometime as if it is going to connect and comes up with the following message:
Network error: Connection timed out
I have already disabled the firewall on my Windows machine which I have PuTTy installed on. Now I am not sure if the issue could be with my Linux box or my application.
Please help.
