networking shortest path?

[unf0rg0tt3n]

Hey guys,

 

I have a issue with my network at home.

in my living room I have my router but in my study we do not have wired network so I used a TP-Link RE650 which has 800Mbps.

The RE650 has a switch attached to it, that has my desktop and homelab server.

 

How to achieve that the desktop will use the shortest path to my server? It can't be possible that my desktop has file transfers of only 60MB/s to my server (with virtualised freenas).

Because a benchmark of the drive write speeds will result in 1.6GB/s. how to fix this? Is this a hypervisor problem or pure network?

 

thanks.

[Windows7ge]

Once the Forwarding Table is populated in the Switch the Switch will automatically forward frames directly between the two interfaces bypassing the router on that wireless connection. It's already taking the shortest path if I understand how this network is setup physically correctly.

[unf0rg0tt3n]

5 minutes ago, Windows7ge said:

Once the Forwarding Table is populated in the Switch the Switch will automatically forward frames directly between the two interfaces bypassing the router on that wireless connection. It's already taking the shortest path if I understand how this network is setup physically correctly.

Thanks! my guess... you understand the setup if i read the answer. How to check if those forwarding tables are already populated?

[Windows7ge]

1 minute ago, unf0rg0tt3n said:

Thanks! my guess... you understand the setup if i read the answer. How to check if those forwarding tables are already populated?

You can't unless it's a switch that supports RS232/a Console Port with the commands to print the forwarding table to the console.

 

You can run an iperf test. That'd be a very solid measurement of what the network is actually capable of.

[unf0rg0tt3n]

37 minutes ago, Windows7ge said:

You can't unless it's a switch that supports RS232/a Console Port with the commands to print the forwarding table to the console.

 

You can run an iperf test. That'd be a very solid measurement of what the network is actually capable of.

Thanks! Direct NIC passthrough had better results. file transfer speeds went from 60MB/s to 110MB/s

[Windows7ge]

3 minutes ago, unf0rg0tt3n said:

Thanks! Direct NIC passthrough had better results. file transfer speeds went from 60MB/s to 110MB/s

Out of curiosity did you try VirtIO (paravirtualization) as oppose to a emulated NIC like the e1000? VirtIO performs very well without having to dedicate hardware to a VM.

[unf0rg0tt3n]

25 minutes ago, Windows7ge said:

Out of curiosity did you try VirtIO (paravirtualization) as oppose to a emulated NIC like the e1000? VirtIO performs very well without having to dedicate hardware to a VM.

Virtio isn't recognized for some reason. My board is a supermicro. it has 2x 1Gb ethernet and a dedicated ipmi. Only the nas needs these crazy speeds, other VM's don't

[Windows7ge]

3 minutes ago, unf0rg0tt3n said:

Virtio isn't recognized for some reason. My board is a supermicro. it has 2x 1Gb ethernet and a dedicated ipmi. Only the nas needs these crazy speeds, other VM's don't

Well if you have the port to spare. I'm curious how you passed it though though. I'd expect both ports on a board to be in the same IOMMU group unless they have separate chips on the board. When they're in the same group I've been told splitting them is a pain.

[unf0rg0tt3n]

5 minutes ago, Windows7ge said:

Well if you have the port to spare. I'm curious how you passed it though though. I'd expect both ports on a board to be in the same IOMMU group unless they have separate chips on the board. When they're in the same group I've been told splitting them is a pain.

just added a hostpci adapter and selected the nic. I have made certain changes for a graphics card to a ubuntu vm.

I have a supermicro X9DRL-iF

[Windows7ge]

3 minutes ago, unf0rg0tt3n said:

just added a hostpci adapter and selected the nic. I have made certain changes for a graphics card to a ubuntu vm.

I have a supermicro X9DRL-iF

Oh nice. I have a Supermicro X10DRI-T and it's been nothing but trouble.

I don't use that server for virtualization projects though I am thinking about doing so in the future.

 

What do you use for a hypervisor?

[unf0rg0tt3n]

21 hours ago, Windows7ge said:

Oh nice. I have a Supermicro X10DRI-T and it's been nothing but trouble.

I don't use that server for virtualization projects though I am thinking about doing so in the future.

 

What do you use for a hypervisor?

How so? Why so much trouble? It's the newer generation right?

I have mine with 2* e5-2680v2 and 256GB or ram.

I am using proxmox VE, it's free and open source, based on debian. Very stable too

its running freenas, database, media server and home-assistant. I definitely suggest on using it

[Windows7ge]

52 minutes ago, unf0rg0tt3n said:

How so? Why so much trouble? It's the newer generation right?

1. When it first showed up one of the 10Gbit ports was dead. Replacing it required me to pay-up the value of the board for "Advanced Shipping" (So I paid for the board twice). Once they got the old board back I was refunded.
2. RAM has been the biggest pain with this thing. RAM with matching stickers but different chip layout won't work with each other. They all had to be matching modules.
3. The built in X540 NIC runs hot and there's no great/easy way to cool it when a bunch of expansion cards are installed over it.

Troublesome but when it works it works. I don't plan on buying Supermicro or NEMIX again.

 

59 minutes ago, unf0rg0tt3n said:

I have mine with 2* e5-2680v2 and 256GB or ram.

I am using proxmox VE, it's free and open source, based on debian. Very stable too

its running freenas, database, media server and home-assistant. I definitely suggest on using it

I have mine with 2x E5-2698v3's and 0.5TB of RAM.

This server is running Windows Server but my VM server is also running PROXMOX VE. I love it.

I've got mine running a bunch of LXC containers, FreeNAS, Windows w/ GPU Pass-though, Ubuntu, Linux Mint, misc projects.

[unf0rg0tt3n]

12 hours ago, Windows7ge said:

1. When it first showed up one of the 10Gbit ports was dead. Replacing it required me to pay-up the value of the board for "Advanced Shipping" (So I paid for the board twice). Once they got the old board back I was refunded.
2. RAM has been the biggest pain with this thing. RAM with matching stickers but different chip layout won't work with each other. They all had to be matching modules.
3. The built in X540 NIC runs hot and there's no great/easy way to cool it when a bunch of expansion cards are installed over it.

Troublesome but when it works it works. I don't plan on buying Supermicro or NEMIX again.

Oh damn that that's a huge pain in the butt.

But 10GBe does run very hot indeed. Fiber will not do that. Unfortunately I only have those 1GBe nics

12 hours ago, Windows7ge said:

I have mine with 2x E5-2698v3's and 0.5TB of RAM.

This server is running Windows Server but my VM server is also running PROXMOX VE. I love it.

I've got mine running a bunch of LXC containers, FreeNAS, Windows w/ GPU Pass-though, Ubuntu, Linux Mint, misc projects.

No way! Nice!

What GPU do you have and I case of nvidia how have you fixed code 43?

[Windows7ge]

5 hours ago, unf0rg0tt3n said:

Oh damn that that's a huge pain in the butt.

But 10GBe does run very hot indeed. Fiber will not do that. Unfortunately I only have those 1GBe nics

My other servers and desktop run on fiber NICs. They do run quite a bit cooler.

 

5 hours ago, unf0rg0tt3n said:

No way! Nice!

What GPU do you have and I case of nvidia how have you fixed code 43?

I use AMD. If you'd call that a fix. NVIDIA setup their desktop cards to detect if they're running in a virtual environment. If they find that they are the driver basically commits seppuku and Device Manager reports Error 43. NVIDIA wants you to use their Quadro, Tesla, etc series of GPU. There are ways to trick Windows into thinking its not in a VM which enables the NVIDIA driver to work but I've been told success is hit-or-miss.

[unf0rg0tt3n]

17 hours ago, Windows7ge said:

I use AMD. If you'd call that a fix. NVIDIA setup their desktop cards to detect if they're running in a virtual environment. If they find that they are the driver basically commits seppuku and Device Manager reports Error 43. NVIDIA wants you to use their Quadro, Tesla, etc series of GPU. There are ways to trick Windows into thinking its not in a VM which enables the NVIDIA driver to work but I've been told success is hit-or-miss.

I have used a Quadro 600 card but that didn't work out. according to nvidia you need a subscription to enable the special function.

AMD worked instantly and Nvidia GTX 750TI only worked inside a linux VM.

[Alex Atkin UK]

I had an RTX 2080 working under qemu without any issues, but I was always expecting NVIDIA to find a way to detect it and block it.

[Windows7ge]

7 hours ago, unf0rg0tt3n said:

I have used a Quadro 600 card but that didn't work out. according to nvidia you need a subscription to enable the special function.

AMD worked instantly and Nvidia GTX 750TI only worked inside a linux VM.

Yeah, AMD just doesn't care. NVIDIA doesn't want to hurt their server/workstation class of cards. Why let people pass-though a $1000 card when they could block it forcing you to buy a $5000 card with only a couple more bells & whistles?

 

1 hour ago, Alex Atkin UK said:

I had an RTX 2080 working under qemu without any issues, but I was always expecting NVIDIA to find a way to detect it and block it.

I have been curious as to how Linus has been passing though 1080Ti's and 2080TI's on UNRAID. I'm guessing the way in which the NVIDIA driver/hardware detect the virtual environment is a setting not all hypervisors share so it just works sometimes. Personally I love QEMU. Will be working on a QEMU GPU pass-though guide for Debian soon.