Setting up Hyper V virtual network

Question

I have a Windows 2008 R2 server with 4 IPs, all on same NIC. I need to setup CentOS + cPanel on Hyper V.

I followed the instructions here:Virtual Network using Hyper-V

Now when I setup a virtual network, with access to external network I loose access to the server alltogether. I have to go from KVM and remove the virtual network to get RDP access.

My setup needs to be like following:

• Physical Server
  • Hyper V
    • cPanel/centos Server
    • Windows machine 1
    • Windows Machine 2

Any suggestions would help. TIA