Jump to content

General Virtualization Discussion Thread

Hi, i have been using KVM with GPU passthrough for some time now on Asus Motherboard and Intel Xeon CPU. I'm due for an upgrade, and fancy something like an AMD Ryzen 9 3900X Processor, so was trying to research a suitable (sub £250.00) motherboard that has good support for GPU passthrough and, if possible, SR-IOV support.

Would appreciate any working knowledge and experience in this area please.

 

kind regards.

Link to comment
Share on other sites

Link to post
Share on other sites

4 hours ago, speedyrazor said:

Hi, i have been using KVM with GPU passthrough for some time now on Asus Motherboard and Intel Xeon CPU. I'm due for an upgrade, and fancy something like an AMD Ryzen 9 3900X Processor, so was trying to research a suitable (sub £250.00) motherboard that has good support for GPU passthrough and, if possible, SR-IOV support.

Would appreciate any working knowledge and experience in this area please.

 

kind regards.

I use an ASRock Taichi X570 with my 3950x, with IOMMU passthrough on UnRAID (QEMU/KVM) for GPU's to my VM's and it works perfectly fine. 

As for SR-IOV I think thats more of a VBIOS limitation isn't it? (e.g Nvidia only enable that on their Grid/Tesla cards)

Spoiler

Desktop: Ryzen9 5950X | ASUS ROG Crosshair VIII Hero (Wifi) | EVGA RTX 3080Ti FTW3 | 32GB (2x16GB) Corsair Dominator Platinum RGB Pro 3600Mhz | EKWB EK-AIO 360D-RGB | EKWB EK-Vardar RGB Fans | 1TB Samsung 980 Pro, 4TB Samsung 980 Pro | Corsair 5000D Airflow | Corsair HX850 Platinum PSU | Asus ROG 42" OLED PG42UQ + LG 32" 32GK850G Monitor | Roccat Vulcan TKL Pro Keyboard | Logitech G Pro X Superlight  | MicroLab Solo 7C Speakers | Audio-Technica ATH-M50xBT2 LE Headphones | TC-Helicon GoXLR | Audio-Technica AT2035 | LTT Desk Mat | XBOX-X Controller | Windows 11 Pro

 

Spoiler

Server: Fractal Design Define R6 | Ryzen 3950x | ASRock X570 Taichi | EVGA GTX1070 FTW | 64GB (4x16GB) Corsair Vengeance LPX 3000Mhz | Corsair RM850v2 PSU | Fractal S36 Triple AIO | 12 x 8TB HGST Ultrastar He10 (WD Whitelabel) | 500GB Aorus Gen4 NVMe | 2 x 2TB Samsung 970 Evo Plus NVMe | LSI 9211-8i HBA

 

Link to comment
Share on other sites

Link to post
Share on other sites

5 hours ago, speedyrazor said:

Hi, i have been using KVM with GPU passthrough for some time now on Asus Motherboard and Intel Xeon CPU. I'm due for an upgrade, and fancy something like an AMD Ryzen 9 3900X Processor, so was trying to research a suitable (sub £250.00) motherboard that has good support for GPU passthrough and, if possible, SR-IOV support.

Would appreciate any working knowledge and experience in this area please.

 

kind regards.

I don't use the AM4 platform personally but I have been told some of the mainstream boards support enabling IOMMU groups.

 

SR-IOV itself I don't know much about except in regard to AMD workstation class GPUs. I'm aware multi-port network cards can support SR-IOV but I'm not sure what BIOS functionality would warrant the motherboard supporting it.

 

Motherboards that I know should support IOMMU groups and may very well support the SR-IOV functionality would be the ASRock Rack X470D4U and the ASRock Rack X470D4U2-2T both support the 3900X with BIOS update.

Link to comment
Share on other sites

Link to post
Share on other sites

5 hours ago, Jarsky said:

I use an ASRock Taichi X570 with my 3950x, with IOMMU passthrough on UnRAID (QEMU/KVM) for GPU's to my VM's and it works perfectly fine. 

As for SR-IOV I think thats more of a VBIOS limitation isn't it? (e.g Nvidia only enable that on their Grid/Tesla cards)

Hi, thanks for the reply, I apologies, I should have been clearer on the SR-IOV requirement. I wanted SR-IOV option for 10G network card, allowing more passthrough and usage options to VM's.

Link to comment
Share on other sites

Link to post
Share on other sites

3 minutes ago, speedyrazor said:

Hi, thanks for the reply, I apologies, I should have been clearer on the SR-IOV requirement. I wanted SR-IOV option for 10G network card, allowing more passthrough and usage options to VM's.

If you install a server grade NIC that supports SR-IOV you should be set. As far as I'm aware the motherboard won't require additional features to utilize an AIC with SR-IOV support.

 

Now setting up the software. Such as QEMU to use it. I don't have experience with that.

Link to comment
Share on other sites

Link to post
Share on other sites

2 hours ago, speedyrazor said:

Hi, thanks for the reply, I apologies, I should have been clearer on the SR-IOV requirement. I wanted SR-IOV option for 10G network card, allowing more passthrough and usage options to VM's.

I found something better that should do the trick here. On the ASRock Rack X470D4U2-2T that I linked it has a built-in X550-AT2 dual port 10Gbit NIC. According to the Intel Ark site the X550-AT2 on that motherboard supports SR-IOV. This would leave both PCIe slots free for your GPUs.

Link to comment
Share on other sites

Link to post
Share on other sites

  • 1 month later...

Hello ppl, Im currently running virtual machines through XenProject VM Host ( legacy choice ). And thinking about transfering to KVM. I wonder if any1 is using KVM with AMD EPYC CPUs. Im specialy interested in SMT on those CPUs in KVM, because in XenProject the SMT does not work, comunity promises they will include the SMT feature, but who knows when .... And since KVM is getting more attention than only comunity created software, im hoping for more support and features on KVM :)

Link to comment
Share on other sites

Link to post
Share on other sites

7 hours ago, Micin said:

Hello ppl, Im currently running virtual machines through XenProject VM Host ( legacy choice ). And thinking about transfering to KVM. I wonder if any1 is using KVM with AMD EPYC CPUs. Im specialy interested in SMT on those CPUs in KVM, because in XenProject the SMT does not work, comunity promises they will include the SMT feature, but who knows when .... And since KVM is getting more attention than only comunity created software, im hoping for more support and features on KVM :)

I don't have direct experience with EPYC processors but I have worked with Threadripper which is a slightly cut down version of EYPC. From my own experiments using QEMU/KVM it runs really well, it's quite stable and hardware pass-through works great. Nearly bare metal performance if you optimize the VMs.

Link to comment
Share on other sites

Link to post
Share on other sites

  • 1 year later...

Bonjour a tous voila après pas mal de bidouille mais toujours en erreur 43 ceci est sous proxmox j'ai testé Unraid ,Proxmox,KVM ,je voie bien chacun des gpu mais j'ai la chance d'avoir un écran noir et erreur 43 tout le temps bien dommage le potentiel que j'ai envisagé pour cette carte ne semble pas exploitable mais l'idée de https://looking-glass.io/ me parait cool je vais testé cela .

Spoiler

l'imagination et plus importante que le savoir A.E.

 

Capture d’écran 2021-10-30 à 14.08.39.png

Capture d’écran 2021-10-29 à 11.39.39.png

Link to comment
Share on other sites

Link to post
Share on other sites

2 hours ago, MGV said:

Bonjour a tous voila après pas mal de bidouille mais toujours en erreur 43 ceci est sous proxmox j'ai testé Unraid ,Proxmox,KVM ,je voie bien chacun des gpu mais j'ai la chance d'avoir un écran noir et erreur 43 tout le temps bien dommage le potentiel que j'ai envisagé pour cette carte ne semble pas exploitable mais l'idée de https://looking-glass.io/ me parait cool je vais testé cela .

  Hide contents

l'imagination et plus importante que le savoir A.E.

 

Capture d’écran 2021-10-30 à 14.08.39.png

Capture d’écran 2021-10-29 à 11.39.39.png

Bonjour désolé mais je ne parle pas français. Anglais? Si vous pouvez connecter un moniteur au GPU R9 290X, il s'éteint si aucun moniteur n'est connecté. Peut provoquer cette erreur.

 

PROXMOX GPU driver?

lspci -vnn

 

Link to comment
Share on other sites

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

×