Jump to content

Hello to everyone,

after realising my first "server" build, i want to extent my vision. I work in a company where there are about 18 computers and i would like to centralize all of them. Basically ditch the one person-one pc tower concept and transfer all the computers into vms in servers. 

I started by making a custom server [5950x/64gb/2TBnvme/2x1660ti/ESXi]. This server is in a server room and holds 4 VMs, two of them are used by designers for 2D-3D CAD and the other two for office use. This system works perfect for now.

So i want to use the same concept for all the other pcs in our business. All the VMs in question will only be used for office use. I am looking into making another server consisted of the following:

  • Ryzen 5950x

  • 64gb Ram

  • 2TB 980 Pros

  • 6*gt1030

  • ESXi 7.0 (is there a better host for this application?)

After a lot of research i found that the easiest and cheapest way to access the VMs is by using a KVM extender (kvm over ethernet). That is the reason i will use the GPUs as well.

My question is whether i can hook up 6 GPUs in a commercial X570 motherboard that has 6 pcie (2* x16 & 1* x8 & 3* x1) using x1 to x16 riser cards? The gpus will then connect to the KVMs and give access wherever in the network.

Reasons to do it:

  • Central management

  • Might be cheaper on a full scale (rather than buying seperate pcs)

  • Easy to deploy new pc

  • Easy to backup

  • Easy to redeploy after failure

  • Controlled enviroment in a server room with UPS

  • Might be used for computers hooked-up on machines, which is a big plus in case of failure.

  • Easier to maintain with consumer parts

 

Reasons not to do it:

  • Big pain in the a** for the one realising it

  • Might be more expensive to start with

  • Don't know if it will actually work properly

Feel free to leave your negative/positive comments and thoughts :)

Link to comment
https://linustechtips.com/topic/1466793-multi-gpu-vms-server/
Share on other sites

Link to post
Share on other sites

3 hours ago, Ale3ko said:

Reasons not to do it:

The other big one to add is if the server has issues now everyone can't work instead of just the user of the system.

 

Id also manage a small buiness with computers, and find its a lot easier to just have a desktop/laptop for all the users. Then if you have extras just swap in a spare system. For management, use some sort of system management solution so you don't have to setup things manually on each system.

 

The correct way to connect to this would be using vmware horizon. Then you can use server gpus and have multiple users per gpu, and don't have to have kvm extenders, and do it all over the network. You can also have multiple systems in a cluster so if a server fails the users can be switched to a different server. The problem is this solution is much more expensive.

Link to comment
https://linustechtips.com/topic/1466793-multi-gpu-vms-server/#findComment-15649680
Share on other sites

Link to post
Share on other sites

Short answer…. Don’t. For reasons listed above.

 

Servers are good for server style workloads, client machines are not “server style workloads”. Can it be done. Sure… should it be done? In almost every case, no. 

Rig: i7 13700k +Contact Frame - - Asus Z790-P Wifi - - RTX 4080 - - 4x16GB 6000MHz - - Samsung 990 Pro 2TB NVMe Boot + Main Programs - - Crucial P3 2TB NVMe for photo work - - Corsair RM850x - - Sound BlasterX EA-5 - - Corsair XC8 JTC Edition - - Corsair GPU Full Cover GPU Block - - PTM 7950 - - XT45 X-Flow 420 + UT60 280 rads externally mounted - - EK XRES RGB PWM - - Fractal Define S2 - - DellAlienware AW3423DWF 34" -- Logitech Pro X Superlight - - Logitech G710+ - - LTT Northern Lights Deskpad

 

Headphones/amp/dac: Schiit Bifrost Multibit - -  Schiit Lyr 3 - - Fostex TR-X00 - - Sennheiser HD 6xx

 

Homelab/Media Server: Proxmox VE host - - 512 NVMe Samsung 980 RAID Z1 for VM's/Proxmox boot - - Xeon e5 2660 V4- - Supermicro X10SRF-i - - 128 GB ECC 2133 - - 10x8TB WD Red RAID Z2 - - 2x 800 GB SAS SSD’s (1 SLOG, 1 L2Arc) - - 45 HomeLab HL15 15 Drive 4U - - Corsair RM650i - - LSI 9305-16i HBA - - TreuNAS + many other VM’s

 

Unifi UDM Pro in front of full unifi network infrastructure

 

iPhone 17 Pro - - MacBook Air M3

Link to comment
https://linustechtips.com/topic/1466793-multi-gpu-vms-server/#findComment-15649805
Share on other sites

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

×