I had ordered cheaper VPS from Hetzner which did not include ipv4 address. Because of that I could not connect the server from my Ubuntu OS which I’m running using VirtualBox.
Luckily I found a solution from AskUbuntu.com which fixed the problem right away.