I guess x11vnc can do that, but whats the point since theres no GUI (I guess) on your server. The only thing you'll get is a black screen. You can control the server with ssh from a terminal on a client. If you need to have a GUI on the server just setup a desktop edition as server and then rdp/vnc to it...

I have two healess ubuntu servers I log in to with ssh. There is nothing to do on a server I cant do with ssh. On one of the servers I've installed a haedless virtualbox with sevral OS - XP, Wn7, fedora etc. But thats not your question...

From ubuntu desktop you can choose:

System->Preference->Remote Desktop

In this window you can set remote access to desktop.

For my opinion the best solution for remote Desktop is NX

(http://nomachine.com), for 1 remote user is free.

Also you can you the free version called freenx

Install "vnc" on your client.

If you wanted a really light-weight way of doing it (and it's a far more secure way of accessing a server because there's far less code on the server and therefore less chance of security bugs being exploited in the software) then you can install just a few packages and as long as your desktop machine has a GUI Desktop Manager (like Gnome or KDE for example) then using SSH on your server you can launch GUI applications:

http://tinyurl.com/6flw2zw

It sounds trickier than it actually is. Be sure to use blowfish compression for SSH to speed things right up (ssh -c blowfish ...)

On window, you can install "X-server"( search google for download) also you can download "vnc" and install it.