Windows XP x64 is built on top of an OS which is 8 years old; true that the x64 release was quite a way after.
Here are the system requirements for Windows XP x64 (via: http://technet.microsoft.com/en-us/library/bb457053.aspx)
Processor
733 MHz Intel Itanium
800 MHz Intel Itanium
Memory
1 GB RAM
1 GB RAM
Conversely Windows Server 2008 is built on top of the same kernel as Vista and has things such as UAC (love it or hate it UAC is a step in the right direction) and a better CPU schedular. Win 2k8 was build in the era of multi-core processing, unlike XP.
For the record here are the Win 2k8 system requirements (via: http://www.microsoft.com/windowsserver2008/en/us/system-requirements.aspx):
Processor
Minimum: 1 GHz (x86 processor) or 1.4 GHz (x64 processor)
Memory
Minimum: 512 MB RAM
My vote - Windown Server 2008.