Virtualized homelab build recommandations

[Edznux]

Hello folks,

 

I'm here today to ask something quite specific about hardware stuff.
I know this period is quite weird in term of hardware and all but I'm planning a new setup for an home lab (with pseudo-gaming capacity).
I've no urgent needs, so if it's worth to wait 2 or 3 extra months I'm OK with that.

I'm looking for an upgrade of my current PC to fit some of my new needs.

At the moment my custom build PC is :

• I5 2500K OC@~4.3Ghz (With an HYPER TX3 cooler)
• GTX 970
• 24 go of 1600 DDR3 RAM
• 128 Go SSD
• 2To HDD
• P8Z68 deluxe IIRC
• Old but good 850W power supply from Corsair

To add a little bit of context, I'm looking to setup an home-lab with Windows (10) + Linux (Probably Arch / Ubuntu based) running simultaneously (hypervisor with 2 VMs : 1 Windows and 1 Linux.
It will run some FPS games on the windows host (so with a GPU pass-through) and some other program that must run on windows (not some wine or similar stuff).

For the games, CSGO / PUBG and Factorio are a must.
My Linux setup is mostly for my nerdy hobbit (Dev, Automation, Security research, heavy computation...). I'm also planning to move some of the game server that I'm currently hosting on my VPS to this setup (Maybe even on an another Linux VM or at least on some containers) (CSGO, Factorio, mostly). I would like to switch from time to time the GPU to the Linux VM to try some linux-only programs with GPU support.

 

My budget is around 1000€ but somewhat flexible.

 

I want to keep as much as possible from my current system for cost reason.

 

After some research I've come up with these things:

• 24 to 32 go of DDR4.
• CPU : I don't really know, I need "high" cores count and individual core speed... AMD / Intel doesn't matter. I'm just worried about AMD compatibility with some hypervisor and with Intel hyper-threading recent issues...
  •     I'm thinking about 8~ cores CPU : 4 for Windows and 4 to the Linux to still be able to do some heavy compute tasks.
• For the motherboard, support for over-clock and support for PCIE SSD + GPU(s) should be enough (1 PCIE slot for GPU + 1 for the PCIE SSD ? and maybe another one for a small GPU if the CPU doesn't provide any ?). It will obviously depend on the CPU and I don't care about RGB stuff (my case got red only fan)
• PCIE-SSD (Optional but that's seems cool for a setup like this)

 

I've build 2 systems on pcpartpicker :

AMD Based
Intel Based

I'm probably asking to much for that but if anyone got some compatibility issue with my peripherals on this type of setup, please let me know :

• Razer Deathadders
• HyperX cloud II
• Corsair K90
• VG248qe monitor (144hz) and another 1080p monitor

For the software side, I don't have strong knowledges in the hypervisor world, so which one is recommended for that kind of build? KVM ? EXSi ? XEN ? other?
I'm OK to tinker with some system things.

 

Additional questions:

1. Is changing OS on the fly possible ? I don't want to restart the whole machine every time I need to go back on the other OS. I've seen some Windows vm inside a linux switching easly, but not VM to VM.
2. Does a multi screen system with different refresh rates can cause problem ? (144hz and 60hz) and will the 144hz work ?
3. Can I switch the GPU from VM to VM just with a restart of the VMs and a little change in the config file ?
4. I will not be able to run VM (like virtualbox one's) inside the guests OSs right ?

 

Thanks for any tips and suggestion !

 

(If you see any mistake, please let me know)

 

[sazrocks]

Don't have time to read the whole post, but just wanted to make a comment; You can't play VAC secured games, such as CSGO, in a virtualized environment. VAC will detect the hypervisor and kick you from matches. Yes, it is stupid. No, you can't do anything about it. No, don't post on the steam forums, the people there will just yell at you.

[Electronics Wizardy]

Since your using this as a workstation why not just install windows and run linux in hyper-v, a type 1 hypervisor thats built into windows..

 

Id get a amd 1700 instead, its the same thing just clocked slower, oc it if you want and you get a good stock cooler.

 

Id then get a 960evo or 850 pro instead of the 750, the 960 drives are faster. 

 

 

[Edznux]

@sazrocks:

 

Wait what ?!

I knew that VAC was bad, but that much is impressive Oo !

I wouldn't have expected that.

 

Thanks for the advice !

 

So, what are my options ? lol

 

1 minute ago, Electronics Wizardy said:

Since your using this as a workstation why not just install windows and run linux in hyper-v, a type 1 hypervisor thats built into windows..

I really don't know, I have very little knowledge in hypervisor, but is the hyper-v windows dependant ? I mean, if I restart the windows host, will that shutdown the other VMs ? I don't want that to happens. (you know, "windows update will restart your computer" while a heavy computation is running on the other host)

 

I take note for the 960evo !

For the amd 1700 (and any ryzen for that matter), I will need another (small) GPU for the second guest OS right ?

 

[Electronics Wizardy]

Just now, Edznux said:

I really don't know, I have very little knowledge in hypervisor, but is the hyper-v windows dependant ? I mean, if I restart the windows host, will that shutdown the other VMs ? I don't want that to happens. (you know, "windows update will restart your computer" while a heavy computation is running on the other host)

 

I take note for the 960evo !

For the amd 1700 (and any ryzen for that matter), I will need another (small) GPU for the second guest OS right ?

 

Id really just run windows on the host. You can disable updates for while in windows 10. Im assuming your can reboot every few months.  This will make games and most dekstop use much easier. Vms for a desktop are a pain.

 

You don't need a second gpu, the other vm's will use a virtual gpu.

[Edznux]

From a security guy, that makes me feel bad haha.

 

My goal is to move my desktop usage on the Linux VM instead of Windows.

So I'm thinking about doing the opposite of your idea : Virtualize the Windows VM and running a KVM Host as the main desktop.

Would that make sense ? I mean, I could probably play CSGO on the host (linux) because it's not virtualized (VAC reason..) ?

But still be able to play windows game after enabling (config + reboot ?) the GPU to the Windows VM.

I could even setup a Linux VM with the "same" desktop environment but for every other usage than CSGO.

 

12 hours ago, Electronics Wizardy said:

Vms for a desktop are a pain.

Can you explain why ? Difficulty to setup, configure and maintain? stability ?

 

The only downside I see as running the KVM host as the desktop and day to day usage is the stability (Adding conflicting package, screwing up some host-only config files and be forced to reboot etc..).

 

I've updated my AMD setup following your advices : https://pcpartpicker.com/list/ChVQbj

 

12 hours ago, Electronics Wizardy said:

You don't need a second gpu, the other vm's will use a virtual gpu.

What is the "Virtual GPU" you are talking about ? In the setup presented above, if the host got the GPU, the windows will start, but the opposite scenario won't work right ? (Windows with the GPU, host with nothing) In that case, a second "micro" GPU (I don't want to spend x hundred euro on another GPU

)

 

Thanks a lot !

[Electronics Wizardy]

2 hours ago, Edznux said:

What is the "Virtual GPU" you are talking about ? In the setup presented above, if the host got the GPU, the windows will start, but the opposite scenario won't work right ? (Windows with the GPU, host with nothing) In that case, a second "micro" GPU (I don't want to spend x hundred euro on another GPU

)

Normally vm's have virtual gpu's that are made in software and use the gpu, not great graphics performance, but you can have as many as you want.

 

2 hours ago, Edznux said:

Can you explain why ? Difficulty to setup, configure and maintai

Pain to work with. Doing things like putting a usb in is annoying. Things will break and be a pain to fix.

 

2 hours ago, Edznux said:

My goal is to move my desktop usage on the Linux VM instead of Windows.

So I'm thinking about doing the opposite of your idea : Virtualize the Windows VM and running a KVM Host as the main desktop.

Would that make sense ? I mean, I could probably play CSGO on the host (linux) because it's not virtualized (VAC reason..) ?

But still be able to play windows game after enabling (config + reboot ?) the GPU to the Windows VM.

I could even setup a Linux VM with the "same" desktop environment but for every other usage than CSGO.

You could run linux on the host, and use windows for gaming in a vm, but then you need a second gpu(possible without, but a complete pain in the but) and second set of keyboard and mice. You can get it working pretty easily though.

[Edznux]

Thanks !

 

So my "final" build will be this one : https://pcpartpicker.com/list/NdQrgL

The 1700 come with a CPU cooler, perfect.

 

The second set of keyboard and mice, I should be ok with a usb switch right? I will consider using synergy (or similar) if that's a pain.

The second GPU, I'm thinking about that but I don't want to spend 200€+ just for some convenience (at least for the moment) (yea, I know, 234$ for an M.2 haha).

 

Thanks for all the infos !