Jump to content

VFIO GPU Pass-though w/ Looking Glass KVM on Ubuntu 19.04

5 minutes ago, SPCQC said:

dGPU (1070ti) : 02:00.0 / 02:00.1

LittleAMDCard : 03:00.0 / 03:00.1

Which are you passing to the VM?

Link to comment
Share on other sites

Link to post
Share on other sites

2 minutes ago, Windows7ge said:

Which are you passing to the VM?

dGPU (1070ti) : 02:00.0 / 02:00.1 . Way more performance for gaming :)

Link to comment
Share on other sites

Link to post
Share on other sites

Just now, SPCQC said:

dGPU (1070ti) : 02:00.0 / 02:00.1 . Way more performance for gaming :)

So you've verified that:

  • The GPU only has .0 & .1 (no .2, .3, etc)?
  • You've verified that it's in it's own IOMMU group?
  • You verified that the drivers were successfully blocked by checking .0 & .1 with lspci -vnn?
  • You connected both .0 & .1 to the VM?
Link to comment
Share on other sites

Link to post
Share on other sites

2 minutes ago, Windows7ge said:

So you've verified that:

  • The GPU only has .0 & .1 (no .2, .3, etc)?
  • You've verified that it's in it's own IOMMU group?
  • You verified that the drivers were successfully blocked by checking .0 & .1 with lspci -vnn?
  • You connected both .0 & .1 to the VM?
  • Yes

image.thumb.png.350ae112a7fd6eebc337b6ea3557d4dd.png

 

  • Looks OK

image.thumb.png.b76f5f91b55fab7c2b1e7c47538acffd.png

 

  • I'm not sure?

image.thumb.png.82c353c3c2c3311f2f6d5cb29db6fdd5.png

 

  • Yes

 

Link to comment
Share on other sites

Link to post
Share on other sites

13 minutes ago, SPCQC said:
  • Yes
  • Looks OK
  • I'm not sure?
  • Yes

Did you try running sudo update-initramfs -u and restarting?

 

Did you add all:

  • nvidiafb
  • nouveau
  • nvidia_drm
  • nvidia
  • snd_hda_intel

To the blacklist file? (Make sure no other devices in the system rely on them)

Link to comment
Share on other sites

Link to post
Share on other sites

Can you confirm my monitor should be connected to which GPU?

Thanks

Link to comment
Share on other sites

Link to post
Share on other sites

51 minutes ago, Windows7ge said:

Did you try running sudo update-initramfs -u and restarting?

 

Did you add all:

  • nvidiafb
  • nouveau
  • nvidia_drm
  • nvidia
  • snd_hda_intel

To the blacklist file? (Make sure no other devices in the system rely on them)

Also, I see that snd_hda_intel is used by both graphic cards, so I can't blacklist this driver.

When I had in my blacklist 

  • nvidiafb
  • nouveau
  • nvidia_drm
  • nvidia

I had no GUI on any of the two GPUs.

Link to comment
Share on other sites

Link to post
Share on other sites

41 minutes ago, SPCQC said:

Can you confirm my monitor should be connected to which GPU?

Thanks

You'll want the display connected to both but you'll want the output set to the AMD GPU (the host GPU).

 

21 minutes ago, SPCQC said:

Also, I see that snd_hda_intel is used by both graphic cards, so I can't blacklist this driver.

When I had in my blacklist 

  • nvidiafb
  • nouveau
  • nvidia_drm
  • nvidia

I had no GUI on any of the two GPUs.

This is definitely part of the problem then. You'll have to use another method to free-up the card.

Link to comment
Share on other sites

Link to post
Share on other sites

2 minutes ago, Windows7ge said:

You'll want the display connected to both but you'll want the output set to the AMD GPU (the host GPU).

What? How can I do this?

Link to comment
Share on other sites

Link to post
Share on other sites

4 minutes ago, SPCQC said:

What? How can I do this?

Sorry. I should probably ask does your display support multiple inputs? Most modern ones do but old office displays may not or do not.

Link to comment
Share on other sites

Link to post
Share on other sites

2 minutes ago, Windows7ge said:

Sorry. I should probably ask does your display support multiple inputs? Most modern ones do but old office displays may not or do not.

I have a monitor that has a VGA and DVI Input.
You want me to connect

GTX1070TI -> DVI -> Monitor

Radeon 7570 -> VGA -> Monitor

Monitor being the same device?

Link to comment
Share on other sites

Link to post
Share on other sites

12 minutes ago, SPCQC said:

I have a monitor that has a VGA and DVI Input.
You want me to connect

GTX1070TI -> DVI -> Monitor

Radeon 7570 -> VGA -> Monitor

Monitor being the same device?

If you have 2 monitors available you can do this but if you only have one then yes. This way you can track the output of both GPUs.

 

So right now you have two options. You can block the driver based on device address or you can block it based on device ID because you're going to need the snd_hda_intel driver for the host GPU.

Link to comment
Share on other sites

Link to post
Share on other sites

34 minutes ago, Windows7ge said:

If you have 2 monitors available you can do this but if you only have one then yes. This way you can track the output of both GPUs.

 

So right now you have two options. You can block the driver based on device address or you can block it based on device ID because you're going to need the snd_hda_intel driver for the host GPU.

Device ID : 1070TI - Stuck on Purple Screen / Radeon 7570 - Stuck on Black Screen

Device Adress : Same thing

 

I will try some other stuff but I don't know where to head now.

Link to comment
Share on other sites

Link to post
Share on other sites

8 minutes ago, SPCQC said:

Device ID : 1070TI - Stuck on Purple Screen / Radeon 7570 - Stuck on Black Screen

Device Adress : Same thing

 

I will try some other stuff but I don't know where to head now.

What CPU/motherboard are you using?

Link to comment
Share on other sites

Link to post
Share on other sites

Just now, Windows7ge said:

What CPU/motherboard are you using?

HP Z640 
CPU Xeon E5-2620 v3

The motherboard seems to be either 761512-001 or 710325-002

Link to comment
Share on other sites

Link to post
Share on other sites

4 minutes ago, SPCQC said:

HP Z640 
CPU Xeon E5-2620 v3

The motherboard seems to be either 761512-001 or 710325-002

This could potentially be part of the issue but I can't say that definitively. For now lets verify one thing you've enabled both VT-x & VT-d yes?

 

Lets make sure we have the correct problem identified. Can you take a crack at creating the VM again except this time skip adding the GPU devices. Let's see if it's just a pass-though issue or if there's more wrong with it.

Link to comment
Share on other sites

Link to post
Share on other sites

2 minutes ago, Windows7ge said:

This could potentially be part of the issue but I can't say that definitively. For now lets verify one thing you've enabled both VT-x & VT-d yes?

 

Lets make sure we have the correct problem identified. Can you take a crack at creating the VM again except this time skip adding the GPU devices. Let's see if it's just a pass-though issue or if there's more wrong with it.

Out of curiosity, how should I install the drivers for the GPUs? For the NVIDIA, should I Use "Software & Updates" and use the proprietary, tested one?

 

Am testing the VM without the GPU right now.

Link to comment
Share on other sites

Link to post
Share on other sites

6 minutes ago, Windows7ge said:

This could potentially be part of the issue but I can't say that definitively. For now lets verify one thing you've enabled both VT-x & VT-d yes?

 

Lets make sure we have the correct problem identified. Can you take a crack at creating the VM again except this time skip adding the GPU devices. Let's see if it's just a pass-though issue or if there's more wrong with it.

I skip the PCIe host (GPU) and the VM was created successfully.

 

Yes VT-x and VT-D are enabled.

Link to comment
Share on other sites

Link to post
Share on other sites

1 minute ago, SPCQC said:

Out of curiosity, how should I install the drivers for the GPUs? For the NVIDIA, should I Use "Software & Updates" and use the proprietary, tested one?

 

Am testing the VM without the GPU right now.

Like any other program it's recommended to download them strait from the manufacturer to get the latest ones. Going to Microsoft you'd be relying on whatever mechanism they use to pull the driver and it's unknown if they pull it strait from the NVIDIA website or if they just keep an achieve of them. Don't forget if the driver fails to install that you'll have to perform the 11.1 workaround.

Link to comment
Share on other sites

Link to post
Share on other sites

Just now, Windows7ge said:

Like any other program it's recommended to download them strait from the manufacturer to get the latest ones. Going to Microsoft you'd be relying on whatever mechanism they use to pull the driver and it's unknown if they pull it strait from the NVIDIA website or if they just keep an achieve of them. Don't forget if the driver fails to install that you'll have to perform the 11.1 workaround.

I was meaning into Ubuntu, how should I install the drivers? Not into the Win10 VM

Link to comment
Share on other sites

Link to post
Share on other sites

1 minute ago, SPCQC said:

I skip the PCIe host (GPU) and the VM was created successfully.

 

Yes VT-x and VT-D are enabled.

So it is a pass-through issue. What Debian distribution are you using?

 

Good.

Link to comment
Share on other sites

Link to post
Share on other sites

Just now, Windows7ge said:

So it is a pass-through issue. What Debian distribution are you using?

 

Good.

Ubuntu 18.04.3 LTS

Link to comment
Share on other sites

Link to post
Share on other sites

1 minute ago, SPCQC said:

I was meaning into Ubuntu, how should I install the drivers? Not into the Win10 VM

Ah. No you don't. With pass-though the host no longer has access to the GPU. Ubuntu won't be able to use it for anything hence no driver needs to be installed.

Link to comment
Share on other sites

Link to post
Share on other sites

1 minute ago, SPCQC said:

Ubuntu 18.04.3 LTS

For all intensive purposes it should work but it is expected that some steps may be different.

 

Can you show me the contents of both the file you created using Device ID and the file you created using Device Address?

Link to comment
Share on other sites

Link to post
Share on other sites

1 minute ago, Windows7ge said:

For all intensive purposes it should work but it is expected that some steps may be different.

 

Can you show me the contents of both the file you created using Device ID and the file you created using Device Address?

I will do it in the next hours as I deleted them earlier

Link to comment
Share on other sites

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now


×