Check for Listen. If an IP is included with the port, then get rid of it.
If there isn't, then look at the BindAddress directive. If it says '*', then it sounds as if there may be a firewalling problem.
Does the box resolve 'localhost' correctly? If so, is 'lo' working? Can you ping localhost? Can you ping 127.0.0.1?