Thank you for your post.
If you can connect and only occasionally have disconnects, that might point at possible network connectivity issues. Brief network disruptions (for whatever reason) may go unnoticed when you use a web browser, but become immediately visible when you need to maintain a long lasting connection.
That said, from your description I can guess that your Host connects to the server on the same machine. In the Host's internet ID settings try specifying the server name as "localhost" or "127.0.0.1" instead of the server's external IP/DNS, to eliminate a possible loopback issue.
In either case it would help to look at the Host log