Jump to content

Multi GPU-VMs Server

Hello to everyone,

after realising my first "server" build, i want to extent my vision. I work in a company where there are about 18 computers and i would like to centralize all of them. Basically ditch the one person-one pc tower concept and transfer all the computers into vms in servers. 

I started by making a custom server [5950x/64gb/2TBnvme/2x1660ti/ESXi]. This server is in a server room and holds 4 VMs, two of them are used by designers for 2D-3D CAD and the other two for office use. This system works perfect for now.

So i want to use the same concept for all the other pcs in our business. All the VMs in question will only be used for office use. I am looking into making another server consisted of the following:

  • Ryzen 5950x

  • 64gb Ram

  • 2TB 980 Pros

  • 6*gt1030

  • ESXi 7.0 (is there a better host for this application?)

After a lot of research i found that the easiest and cheapest way to access the VMs is by using a KVM extender (kvm over ethernet). That is the reason i will use the GPUs as well.

My question is whether i can hook up 6 GPUs in a commercial X570 motherboard that has 6 pcie (2* x16 & 1* x8 & 3* x1) using x1 to x16 riser cards? The gpus will then connect to the KVMs and give access wherever in the network.

Reasons to do it:

  • Central management

  • Might be cheaper on a full scale (rather than buying seperate pcs)

  • Easy to deploy new pc

  • Easy to backup

  • Easy to redeploy after failure

  • Controlled enviroment in a server room with UPS

  • Might be used for computers hooked-up on machines, which is a big plus in case of failure.

  • Easier to maintain with consumer parts

 

Reasons not to do it:

  • Big pain in the a** for the one realising it

  • Might be more expensive to start with

  • Don't know if it will actually work properly

Feel free to leave your negative/positive comments and thoughts :)

Link to comment
Share on other sites

Link to post
Share on other sites

3 hours ago, Ale3ko said:

Reasons not to do it:

The other big one to add is if the server has issues now everyone can't work instead of just the user of the system.

 

Id also manage a small buiness with computers, and find its a lot easier to just have a desktop/laptop for all the users. Then if you have extras just swap in a spare system. For management, use some sort of system management solution so you don't have to setup things manually on each system.

 

The correct way to connect to this would be using vmware horizon. Then you can use server gpus and have multiple users per gpu, and don't have to have kvm extenders, and do it all over the network. You can also have multiple systems in a cluster so if a server fails the users can be switched to a different server. The problem is this solution is much more expensive.

Link to comment
Share on other sites

Link to post
Share on other sites

Short answer…. Don’t. For reasons listed above.

 

Servers are good for server style workloads, client machines are not “server style workloads”. Can it be done. Sure… should it be done? In almost every case, no. 

Rig: i7 13700k - - Asus Z790-P Wifi - - RTX 4080 - - 4x16GB 6000MHz - - Samsung 990 Pro 2TB NVMe Boot + Main Programs - - Assorted SATA SSD's for Photo Work - - Corsair RM850x - - Sound BlasterX EA-5 - - Corsair XC8 JTC Edition - - Corsair GPU Full Cover GPU Block - - XT45 X-Flow 420 + UT60 280 rads - - EK XRES RGB PWM - - Fractal Define S2 - - Acer Predator X34 -- Logitech G502 - - Logitech G710+ - - Logitech Z5500 - - LTT Deskpad

 

Headphones/amp/dac: Schiit Lyr 3 - - Fostex TR-X00 - - Sennheiser HD 6xx

 

Homelab/ Media Server: Proxmox VE host - - 512 NVMe Samsung 980 RAID Z1 for VM's/Proxmox boot - - Xeon e5 2660 V4- - Supermicro X10SRF-i - - 128 GB ECC 2133 - - 10x4 TB WD Red RAID Z2 - - Corsair 750D - - Corsair RM650i - - Dell H310 6Gbps SAS HBA - - Intel RES2SC240 SAS Expander - - TreuNAS + many other VM’s

 

iPhone 14 Pro - 2018 MacBook Air

Link to comment
Share on other sites

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

×