Slow 10Gbe Speeds from PC to NAS [DS1817+]

[LexenZ]

Hi everyone!

 

I have a DS1817+ with E10G18-T1 installed and my PC has the ASUS XG-C100C with driver version of 2.1.21.0.

I have been reading online about making the most optimum setup (E.g. jumbo frames to 9000 etc etc) but i still couldn't hit my transfer rates of more than 200mb/s even though its a direct connection from PC to NAS.

 

As of below are my XG-C100C adapter property settings:

Downshift Retries: 4

Energy efficient internet: Disabled

Flow control: Enabled

Interrupt Moderation: Enabled

Interrupt Moderation Rate: Adaptive

IPv4 Checksum offload: Rx & Tx Enabled

Jumbo Packet: 9014 Bytes

Large Send offload V1(IPv4): Enabled

Large Send offload V2(IPv4): Enabled

Large Send offload V2(IPv6): Enabled

Link speed: 10G

Local Administered Address: (Blank)

Log Link State Event: Enabled

Maximum Number of RSS queues: 4 Queues

Packet Priority & VLAN: Packet & VLAN Enabled

Receive Buffers: 512

Received side scaling: Enabled

Recv Segment Coalescing (IPv4): Enabled

Recv Segment Coalescing (IPv6): Enabled

TCP/UDP Checksum Offload (IPv4): Rx & Tx Enabled

TCP/UDP Checksum Offload (IPv6): Rx & Tx Enabled

Transmit Buffers: 2096

VLAN ID: 0

VLAN Monitor Mode: Disabled

Wait for Link: Auto detect

 

For my NAS side:

MTU: 9000

No traffic control

Vswitch disabled

I have no idea what's wrong and my first guess was that the pci-e lane that DS1817+ is gen 2 instead of gen 3....

My PC does have a SX8200 pro 2tb installed.

 

Normally i transfer videos (usually 10x 3gb files) from the network itself to the NAS but still hitting less than 200mb/s.

 

I suspected the aquantia controller had some issues. So i switched to X550-T1 adapter instead. This time i installed it at the gen3 lane.

Unfortunately it was worse at half of the speeds (<100mb/s) 

 

So i had to tweak the X550-T1 adapter property settings to get back the 200mb/s as of below:

 

DMA coalescing: Disabled

Flow control: Disabled

Interrupt Moderation: Disabled

Interrupt Moderation Rate: Off

IPsec offload: Disabled

IPv4 Checksum offload: Rx & Tx Enabled

Jumbo Packet: 9014 Bytes

Large Send offload V2(IPv4): Enabled

Large Send offload V2(IPv6): Enabled

Local Administered Address: (Blank)

Log Link State Event: Enabled

Maximum Number of RSS queues: 8 Queues

Packet Priority & VLAN: Packet Priority Enabled

Receive Buffers: 4096

Received side scaling: Enabled

Speed & Duplex: 10gbps full duplex

TCP Checksum Offload (IPv4): Rx & Tx Enabled

TCP Checksum Offload (IPv6): Rx & Tx Enabled

Transmit Buffers: 16384

UDP Checksum Offload (IPv4): Rx & Tx Enabled

UDP Checksum Offload (IPv6): Rx & Tx Enabled

 

For my NAS side:

MTU: 9000

No traffic control

Vswitch disabled

 

I even tried the iperf3 test for the X550-T1 after like an hour of understanding how to do it as of below:

 

 

After all the tweaking as of above and even changing of network cables, nothing is successful.

I contacted Synology support. And i was blamed for using HDDs as it dramatically drops the speed. That kind of answer is most astonishing considering other users online are able to achieve shocking speeds with hard drive specifications lower than mine (I am using 5x10TB Ironwolf pros)

 

I am at a loss here.

1) Are my settings above for the adapter properties correct? 

2) Is the iPerf3 results good or bad? (Is it performing at 10gbe speeds?)

3) What more can i do to change?

 

Sorry to vent it out here because i thought synology support would help me out... but it seems like no conclusive answer is given for me.

 

Regards

John

 

 

 

[Applefreak]

27 minutes ago, LexenZ said:

Hi everyone!

 

I have a DS1817+ with E10G18-T1 installed and my PC has the ASUS XG-C100C with driver version of 2.1.21.0.

I have been reading online about making the most optimum setup (E.g. jumbo frames to 9000 etc etc) but i still couldn't hit my transfer rates of more than 200mb/s even though its a direct connection from PC to NAS.

 

As of below are my XG-C100C adapter property settings:

Downshift Retries: 4

Energy efficient internet: Disabled

Flow control: Enabled

Interrupt Moderation: Enabled

Interrupt Moderation Rate: Adaptive

IPv4 Checksum offload: Rx & Tx Enabled

Jumbo Packet: 9014 Bytes

Large Send offload V1(IPv4): Enabled

Large Send offload V2(IPv4): Enabled

Large Send offload V2(IPv6): Enabled

Link speed: 10G

Local Administered Address: (Blank)

Log Link State Event: Enabled

Maximum Number of RSS queues: 4 Queues

Packet Priority & VLAN: Packet & VLAN Enabled

Receive Buffers: 512

Received side scaling: Enabled

Recv Segment Coalescing (IPv4): Enabled

Recv Segment Coalescing (IPv6): Enabled

TCP/UDP Checksum Offload (IPv4): Rx & Tx Enabled

TCP/UDP Checksum Offload (IPv6): Rx & Tx Enabled

Transmit Buffers: 2096

VLAN ID: 0

VLAN Monitor Mode: Disabled

Wait for Link: Auto detect

 

For my NAS side:

MTU: 9000

No traffic control

Vswitch disabled

I have no idea what's wrong and my first guess was that the pci-e lane that DS1817+ is gen 2 instead of gen 3....

My PC does have a SX8200 pro 2tb installed.

 

Normally i transfer videos (usually 10x 3gb files) from the network itself to the NAS but still hitting less than 200mb/s.

 

I suspected the aquantia controller had some issues. So i switched to X550-T1 adapter instead. This time i installed it at the gen3 lane.

Unfortunately it was worse at half of the speeds (<100mb/s) 

 

So i had to tweak the X550-T1 adapter property settings to get back the 200mb/s as of below:

 

DMA coalescing: Disabled

Flow control: Disabled

Interrupt Moderation: Disabled

Interrupt Moderation Rate: Off

IPsec offload: Disabled

IPv4 Checksum offload: Rx & Tx Enabled

Jumbo Packet: 9014 Bytes

Large Send offload V2(IPv4): Enabled

Large Send offload V2(IPv6): Enabled

Local Administered Address: (Blank)

Log Link State Event: Enabled

Maximum Number of RSS queues: 8 Queues

Packet Priority & VLAN: Packet Priority Enabled

Receive Buffers: 4096

Received side scaling: Enabled

Speed & Duplex: 10gbps full duplex

TCP Checksum Offload (IPv4): Rx & Tx Enabled

TCP Checksum Offload (IPv6): Rx & Tx Enabled

Transmit Buffers: 16384

UDP Checksum Offload (IPv4): Rx & Tx Enabled

UDP Checksum Offload (IPv6): Rx & Tx Enabled

 

For my NAS side:

MTU: 9000

No traffic control

Vswitch disabled

 

I even tried the iperf3 test for the X550-T1 after like an hour of understanding how to do it as of below:

 

 

After all the tweaking as of above and even changing of network cables, nothing is successful.

I contacted Synology support. And i was blamed for using HDDs as it dramatically drops the speed. That kind of answer is most astonishing considering other users online are able to achieve shocking speeds with hard drive specifications lower than mine (I am using 5x10TB Ironwolf pros)

 

I am at a loss here.

1) Are my settings above for the adapter properties correct? 

2) Is the iPerf3 results good or bad? (Is it performing at 10gbe speeds?)

3) What more can i do to change?

 

Sorry to vent it out here because i thought synology support would help me out... but it seems like no conclusive answer is given for me.

 

Regards

John

 

 

 

What kind of a RAID config are you running? My guess, the NAS box does not have enough ram and cpu power to keep up. This will be noticeable if at first the speed is fine, so maybe 500 mb/s and then drops significantly. Your drives should be 7200 rpm, that' won't be the issue. Each drive can easily write at 150 mb/s on their own. I would bet on a hardware bottleneck rather than a config error. I know for a fact that my NAS in the office did improve on performance by upgrading from an Intel 3770k to a Ryzen 5 3600 by almost doubling the speed. I use 8 WD Gold 12 TB drives in RAID Z2 running Debian with a stripped down kernel. I have a Aquantia 107 from Asus in the NAS and the PCs. Transfer speeds are between 370 and 600 mb/s using mixed file sizes (mostly used for backing up)

[FloRolf]

Your iperf results are just 1gbit and not 10gbit. That explains why you only get 100mb/s.

 

As for the 200mb result you had before, that might be a hardware bottleneck. You see, in order to get 10gbe (1gbyte/s) you need both PC's (or NAS in this case) to have storage that fast. Your pc has nvme, that's fine. But your NAS needs SSD's or a big Raid array as well. 

 

 

Edit: okay just reread that you run 5x10tb drives. What config though? Raid5? 

[LexenZ]

21 minutes ago, Applefreak said:

What kind of a RAID config are you running? My guess, the NAS box does not have enough ram and cpu power to keep up. This will be noticeable if at first the speed is fine, so maybe 500 mb/s and then drops significantly. Your drives should be 7200 rpm, that' won't be the issue. Each drive can easily write at 150 mb/s on their own. I would bet on a hardware bottleneck rather than a config error. I know for a fact that my NAS in the office did improve on performance by upgrading from an Intel 3770k to a Ryzen 5 3600 by almost doubling the speed. I use 8 WD Gold 12 TB drives in RAID Z2 running Debian with a stripped down kernel. I have a Aquantia 107 from Asus in the NAS and the PCs. Transfer speeds are between 370 and 600 mb/s using mixed file sizes (mostly used for backing up)

Hi there Applefreak,

Thanks for the response.

Apologies i did not include the Raid config, it is on SHR (Synology Hybrid Raid).

My DS1817+ has 4 cores and 8GB of ram instead of the 4GB. 

I know its an config error or somehow, i am confident that it is not the NAS box spec issue. Thing is, what are the settings for that? That's what i want to know.

Would you be able to share your adapter settings for me to try?

14 minutes ago, FloRolf said:

Your iperf results are just 1gbit and not 10gbit. That explains why you only get 100mb/s.

 

As for the 200mb result you had before, that might be a hardware bottleneck. You see, in order to get 10gbe (1gbyte/s) you need both PC's (or NAS in this case) to have storage that fast. Your pc has nvme, that's fine. But your NAS needs SSD's or a big Raid array as well. 

 

 

Edit: okay just reread that you run 5x10tb drives. What config though? Raid5? 

Hi there FloRolf,

Thanks for the response as well.

Apologies i did not include the Raid config, it is on SHR (Synology Hybrid Raid).

So my iPerf results are on the gigabit side.. but i have pushed 10gbe connections on both sides. What is the thing that it is detecting gigabit instead of 10Gbe? That's what i want to know....

[FloRolf]

10 minutes ago, LexenZ said:

Hi there Applefreak,

Thanks for the response.

Apologies i did not include the Raid config, it is on SHR (Synology Hybrid Raid).

My DS1817+ has 4 cores and 8GB of ram instead of the 4GB. 

I know its an config error or somehow, i am confident that it is not the NAS box spec issue. Thing is, what are the settings for that? That's what i want to know.

Would you be able to share your adapter settings for me to try?

Hi there FloRolf,

Thanks for the response as well.

Apologies i did not include the Raid config, it is on SHR (Synology Hybrid Raid).

So my iPerf results are on the gigabit side.. but i have pushed 10gbe connections on both sides. What is the thing that it is detecting gigabit instead of 10Gbe? That's what i want to know....

 

OK first of, your raid array should theoretically give you about 400mb/s read and write. That's good. 

Now, your iperf results don't tell you your drive speed but literally only the speed of the connection. That means you have something incorrectly configured. 

As far as I understand you have a 10gbe NIC in each device and they are directly connected with one ethernet cable right? Please make sure that cable is CAT6 or CAT6a instead of CAT5e, but even 5e should give you 400mb/s, depending on how long that cable is. 

 

Do you mind sharing Screenshots of your NIC configs from each device? 

 

 

Edit: I'd also say just go back to the C100C and maybe try the X550 in the NAS instead, if possible

[LexenZ]

2 minutes ago, FloRolf said:

 

OK first of, your raid array should theoretically give you about 400mb/s read and write. That's good. 

Now, your iperf results don't tell you your drive speed but literally only the speed of the connection. That means you have something incorrectly configured. 

As far as I understand you have a 10gbe NIC in each device and they are directly connected with one ethernet cable right? Please make sure that cable is CAT6 or CAT6a instead of CAT5e, but even 5e should give you 400mb/s, depending on how long that cable is. 

 

Do you mind sharing Screenshots of your NIC configs from each device? 

Hi FloRolf,

 

Yes there is something horribly wrong with my configurations. BUT, i have no idea what settings i should do to it.

If you are asking for the adapter properties it is as of above initial post for both Asus and X550-T1. Or may i know what other info do you require? 

 

For the connection yes so the internet adapters are both connected in my PC's PCIE lanes and a CAT8 cable is directly connected to the NAS's E10G18-T1. 

As for the concern of using a "CAT8" cable (1metre), no worries on that, i tested it on another legit CAT6 cable of 3 metres, both transfer rates are exactly the same. Therefore hardware failures can be ruled out in my opinion.

Well i could be wrong but... i can't see any failure in hardware wise for now hahaha. (I mean i did get the X550-T1 thinking the Asus adapter is spoilt)

[FloRolf]

16 minutes ago, LexenZ said:

Hi FloRolf,

 

Yes there is something horribly wrong with my configurations. BUT, i have no idea what settings i should do to it.

If you are asking for the adapter properties it is as of above initial post for both Asus and X550-T1. Or may i know what other info do you require? 

 

For the connection yes so the internet adapters are both connected in my PC's PCIE lanes and a CAT8 cable is directly connected to the NAS's E10G18-T1. 

As for the concern of using a "CAT8" cable (1metre), no worries on that, i tested it on another legit CAT6 cable of 3 metres, both transfer rates are exactly the same. Therefore hardware failures can be ruled out in my opinion.

Well i could be wrong but... i can't see any failure in hardware wise for now hahaha. (I mean i did get the X550-T1 thinking the Asus adapter is spoilt)

Ok i just looked at it again and i think i know the issue,

Your NAS is 169.254.25.13 while your PC is 169.254.236.97 (or vice versa). They are on different Networks basically. So i think your 10G card in the NAS kinda tries to reroute over the internal Ethernet ports or something.

Can you change your IP adresses so they are on the same network? For example both 169.254.25.XX

[Lurick]

32 minutes ago, FloRolf said:

Ok i just looked at it again and i think i know the issue,

Your NAS is 169.254.25.13 while your PC is 169.254.236.97 (or vice versa). They are on different Networks basically. So i think your 10G card in the NAS kinda tries to reroute over the internal Ethernet ports or something.

Can you change your IP adresses so they are on the same network? For example both 169.254.25.XX

APIPA addresses actually use a /16 subnet mask so the IP address space is fine. This is of course assuming OP didn't hard code a different subnet mask or anything.

[LexenZ]

41 minutes ago, FloRolf said:

Ok i just looked at it again and i think i know the issue,

Your NAS is 169.254.25.13 while your PC is 169.254.236.97 (or vice versa). They are on different Networks basically. So i think your 10G card in the NAS kinda tries to reroute over the internal Ethernet ports or something.

Can you change your IP adresses so they are on the same network? For example both 169.254.25.XX

Hi FloRolf,

 

Apologies but i tried to set the NAS side of the IP address to 169.254.25.15 so that it aligns with the X550 adapter, but unfortunately now i can't even connect to the NAS.

May I know what's the correct procedure for this? As I do not know how to do it.

 

What i have done to correct the situation was to leave the NAS side untouched (DHCP automatic), i set the Adapter side by manually putting 169.254.236.98 , with the same subnet mask of 255.255.0.0. The transfer rate is still the same and lower even unfortunately...

 

I think i may have done it wrongly, please advise me on this~ 

[LexenZ]

1 hour ago, Lurick said:

APIPA addresses actually use a /16 subnet mask so the IP address space is fine. This is of course assuming OP didn't hard code a different subnet mask or anything.

Hi Lurick,

 

Apologies unfortunately i don't really understand what you mean as i am not that technical. 

If your talking about hard code i just changed the adapter IPv4 settings manually to fit the NAS box's IP.

 

Do let me know if i did anything wrong here~ 

[LexenZ]

New update as of 18-Dec-2020 11:33pm SGT:

 

So i decided to try what FloWolf has asked me to do:

 

 

I had my settings as shown for the adapter and NAS side all manually configured.

However, the situation of the transfer rate is still within 200mb/s...

 

I am at a loss now. Any other suggestions?

 

[FloRolf]

7 hours ago, LexenZ said:

New update as of 18-Dec-2020 11:33pm SGT:

 

So i decided to try what FloWolf has asked me to do:

 

 

I had my settings as shown for the adapter and NAS side all manually configured.

However, the situation of the transfer rate is still within 200mb/s...

 

I am at a loss now. Any other suggestions?

 

Does Synology maybe have a Array Benchmark tool? Maybe that's all you get. Then maybe there's something wrong with your array instead of your network. 

[jasonvp]

Unless your machine is running at high CPU load, setting the MTU to 9000 isn't going to help you.  Try running iperf with parallelization.  Windows is absolute garbage at 10GigE throughput, as I've found through extensive testing here at home.  Try adding "-p 4" at the end of the iperf command.

[LexenZ]

3 hours ago, FloRolf said:

Does Synology maybe have a Array Benchmark tool? Maybe that's all you get. Then maybe there's something wrong with your array instead of your network. 

Hi FloRolf,

 

I don't know if synology has a array benchmark tool. I only use the crystaldiskmark software as a test with 8gb file transfer. Results as of below:

With regards to "something wrong with your array", i want to know what exactly is wrong with it in the first place? Because i have everything set up as per what is intended. And there is no errors nor mistakes for me to find out for now.

Tweaking of the adapter properties drastically changes the performance which i have no idea why.

Say for e.g. it is recommended to have flow control on, but when i turn it off for the X550 it works, but for the Asus adapter if i turn it off it doesn't.....

 

1 hour ago, jasonvp said:

Unless your machine is running at high CPU load, setting the MTU to 9000 isn't going to help you.  Try running iperf with parallelization.  Windows is absolute garbage at 10GigE throughput, as I've found through extensive testing here at home.  Try adding "-p 4" at the end of the iperf command.

Hi Jasonvp,

 

So i decided to run a 50gb transfer instead of the 5gb. I see increase in cpu load about (57%). Transfer speed is still the same hovering below 200mb/s this time.

 

As per the iperf with parallelisation, you may find my results below:

 

C:\Users\Nepht\Downloads\iperf-3.1.3-win64>iperf3 -c 10.10.10.5 -P 4
Connecting to host 10.10.10.5, port 5201
[  4] local 10.10.10.10 port 56853 connected to 10.10.10.5 port 5201
[  6] local 10.10.10.10 port 56854 connected to 10.10.10.5 port 5201
[  8] local 10.10.10.10 port 56855 connected to 10.10.10.5 port 5201
[ 10] local 10.10.10.10 port 56856 connected to 10.10.10.5 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec   122 MBytes  1.02 Gbits/sec
[  6]   0.00-1.00   sec   136 MBytes  1.14 Gbits/sec
[  8]   0.00-1.00   sec   119 MBytes   996 Mbits/sec
[ 10]   0.00-1.00   sec   141 MBytes  1.18 Gbits/sec
[SUM]   0.00-1.00   sec   518 MBytes  4.34 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec   159 MBytes  1.34 Gbits/sec
[  6]   1.00-2.00   sec   146 MBytes  1.22 Gbits/sec
[  8]   1.00-2.00   sec   152 MBytes  1.28 Gbits/sec
[ 10]   1.00-2.00   sec   151 MBytes  1.27 Gbits/sec
[SUM]   1.00-2.00   sec   608 MBytes  5.11 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec   133 MBytes  1.12 Gbits/sec
[  6]   2.00-3.00   sec   148 MBytes  1.24 Gbits/sec
[  8]   2.00-3.00   sec   148 MBytes  1.24 Gbits/sec
[ 10]   2.00-3.00   sec   165 MBytes  1.38 Gbits/sec
[SUM]   2.00-3.00   sec   594 MBytes  4.98 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec   144 MBytes  1.21 Gbits/sec
[  6]   3.00-4.00   sec   162 MBytes  1.36 Gbits/sec
[  8]   3.00-4.00   sec   164 MBytes  1.37 Gbits/sec
[ 10]   3.00-4.00   sec   180 MBytes  1.51 Gbits/sec
[SUM]   3.00-4.00   sec   651 MBytes  5.46 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec   138 MBytes  1.16 Gbits/sec
[  6]   4.00-5.00   sec   168 MBytes  1.41 Gbits/sec
[  8]   4.00-5.00   sec   176 MBytes  1.47 Gbits/sec
[ 10]   4.00-5.00   sec   172 MBytes  1.44 Gbits/sec
[SUM]   4.00-5.00   sec   653 MBytes  5.48 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec   146 MBytes  1.22 Gbits/sec
[  6]   5.00-6.00   sec   186 MBytes  1.56 Gbits/sec
[  8]   5.00-6.00   sec   155 MBytes  1.30 Gbits/sec
[ 10]   5.00-6.00   sec   154 MBytes  1.29 Gbits/sec
[SUM]   5.00-6.00   sec   640 MBytes  5.37 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec   137 MBytes  1.15 Gbits/sec
[  6]   6.00-7.00   sec   175 MBytes  1.47 Gbits/sec
[  8]   6.00-7.00   sec   149 MBytes  1.25 Gbits/sec
[ 10]   6.00-7.00   sec   167 MBytes  1.40 Gbits/sec
[SUM]   6.00-7.00   sec   628 MBytes  5.27 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec   160 MBytes  1.34 Gbits/sec
[  6]   7.00-8.00   sec   155 MBytes  1.30 Gbits/sec
[  8]   7.00-8.00   sec   153 MBytes  1.29 Gbits/sec
[ 10]   7.00-8.00   sec   144 MBytes  1.21 Gbits/sec
[SUM]   7.00-8.00   sec   612 MBytes  5.14 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec   146 MBytes  1.23 Gbits/sec
[  6]   8.00-9.00   sec   150 MBytes  1.26 Gbits/sec
[  8]   8.00-9.00   sec   140 MBytes  1.17 Gbits/sec
[ 10]   8.00-9.00   sec   141 MBytes  1.18 Gbits/sec
[SUM]   8.00-9.00   sec   577 MBytes  4.84 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec   133 MBytes  1.12 Gbits/sec
[  6]   9.00-10.00  sec   150 MBytes  1.26 Gbits/sec
[  8]   9.00-10.00  sec   128 MBytes  1.07 Gbits/sec
[ 10]   9.00-10.00  sec   148 MBytes  1.25 Gbits/sec
[SUM]   9.00-10.00  sec   560 MBytes  4.69 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec  1.38 GBytes  1.19 Gbits/sec                  sender
[  4]   0.00-10.00  sec  1.38 GBytes  1.19 Gbits/sec                  receiver
[  6]   0.00-10.00  sec  1.54 GBytes  1.32 Gbits/sec                  sender
[  6]   0.00-10.00  sec  1.54 GBytes  1.32 Gbits/sec                  receiver
[  8]   0.00-10.00  sec  1.45 GBytes  1.24 Gbits/sec                  sender
[  8]   0.00-10.00  sec  1.45 GBytes  1.24 Gbits/sec                  receiver
[ 10]   0.00-10.00  sec  1.53 GBytes  1.31 Gbits/sec                  sender
[ 10]   0.00-10.00  sec  1.53 GBytes  1.31 Gbits/sec                  receiver
[SUM]   0.00-10.00  sec  5.90 GBytes  5.07 Gbits/sec                  sender
[SUM]   0.00-10.00  sec  5.90 GBytes  5.07 Gbits/sec                  receiver

 

iperf Done.

 

From the results above i am guessing its still at gigabit speeds unfortunately based on FloRolf's comments.

[jasonvp]

13 hours ago, LexenZ said:

[SUM]   0.00-10.00  sec  5.90 GBytes  5.07 Gbits/sec                  sender
[SUM]   0.00-10.00  sec  5.90 GBytes  5.07 Gbits/sec                  receiver

 

iperf Done.

 

From the results above i am guessing its still at gigabit speeds unfortunately based on FloRolf's comments.

You most certainly are not at Gigabit speeds, and the results are right there in front of you.  I snipped out all the superfluous output from your iperf3 run.  When you set up four parallel runs, you got 5Gbits/sec.  Bump it up to

-p 6 

and see what happens.  Then try

-p 8

  There's going to be a point of diminishing returns as you increase the parallelization.  But try it anyway.

 

 

 

[LexenZ]

12 hours ago, jasonvp said:

You most certainly are not at Gigabit speeds, and the results are right there in front of you.  I snipped out all the superfluous output from your iperf3 run.  When you set up four parallel runs, you got 5Gbits/sec.  Bump it up to

-p 6 

and see what happens.  Then try

-p 8

  There's going to be a point of diminishing returns as you increase the parallelization.  But try it anyway.

 

 

 

Hi there Jasonvp,

 

You may find the results below:

C:\Users\Nepht\Downloads\iperf-3.1.3-win64>iperf3 -c 10.10.10.5 -P 6
Connecting to host 10.10.10.5, port 5201
[  4] local 10.10.10.10 port 50518 connected to 10.10.10.5 port 5201
[  6] local 10.10.10.10 port 50519 connected to 10.10.10.5 port 5201
[  8] local 10.10.10.10 port 50520 connected to 10.10.10.5 port 5201
[ 10] local 10.10.10.10 port 50521 connected to 10.10.10.5 port 5201
[ 12] local 10.10.10.10 port 50522 connected to 10.10.10.5 port 5201
[ 14] local 10.10.10.10 port 50523 connected to 10.10.10.5 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec   125 MBytes  1.05 Gbits/sec
[  6]   0.00-1.00   sec   118 MBytes   986 Mbits/sec
[  8]   0.00-1.00   sec   123 MBytes  1.03 Gbits/sec
[ 10]   0.00-1.00   sec   104 MBytes   875 Mbits/sec
[ 12]   0.00-1.00   sec  89.4 MBytes   750 Mbits/sec
[ 14]   0.00-1.00   sec  93.2 MBytes   782 Mbits/sec
[SUM]   0.00-1.00   sec   653 MBytes  5.48 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec   160 MBytes  1.34 Gbits/sec
[  6]   1.00-2.00   sec   151 MBytes  1.27 Gbits/sec
[  8]   1.00-2.00   sec   132 MBytes  1.11 Gbits/sec
[ 10]   1.00-2.00   sec   108 MBytes   906 Mbits/sec
[ 12]   1.00-2.00   sec   114 MBytes   952 Mbits/sec
[ 14]   1.00-2.00   sec   115 MBytes   968 Mbits/sec
[SUM]   1.00-2.00   sec   781 MBytes  6.55 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec   152 MBytes  1.28 Gbits/sec
[  6]   2.00-3.00   sec   150 MBytes  1.26 Gbits/sec
[  8]   2.00-3.00   sec   137 MBytes  1.15 Gbits/sec
[ 10]   2.00-3.00   sec   117 MBytes   982 Mbits/sec
[ 12]   2.00-3.00   sec   114 MBytes   953 Mbits/sec
[ 14]   2.00-3.00   sec   113 MBytes   948 Mbits/sec
[SUM]   2.00-3.00   sec   782 MBytes  6.56 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec   156 MBytes  1.31 Gbits/sec
[  6]   3.00-4.00   sec   152 MBytes  1.28 Gbits/sec
[  8]   3.00-4.00   sec   138 MBytes  1.15 Gbits/sec
[ 10]   3.00-4.00   sec   135 MBytes  1.13 Gbits/sec
[ 12]   3.00-4.00   sec   123 MBytes  1.03 Gbits/sec
[ 14]   3.00-4.00   sec   116 MBytes   973 Mbits/sec
[SUM]   3.00-4.00   sec   820 MBytes  6.87 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec   149 MBytes  1.25 Gbits/sec
[  6]   4.00-5.00   sec   163 MBytes  1.37 Gbits/sec
[  8]   4.00-5.00   sec   140 MBytes  1.18 Gbits/sec
[ 10]   4.00-5.00   sec   117 MBytes   978 Mbits/sec
[ 12]   4.00-5.00   sec   113 MBytes   951 Mbits/sec
[ 14]   4.00-5.00   sec   106 MBytes   890 Mbits/sec
[SUM]   4.00-5.00   sec   788 MBytes  6.61 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec   170 MBytes  1.42 Gbits/sec
[  6]   5.00-6.00   sec   144 MBytes  1.21 Gbits/sec
[  8]   5.00-6.00   sec   143 MBytes  1.20 Gbits/sec
[ 10]   5.00-6.00   sec   126 MBytes  1.05 Gbits/sec
[ 12]   5.00-6.00   sec   119 MBytes   994 Mbits/sec
[ 14]   5.00-6.00   sec   124 MBytes  1.04 Gbits/sec
[SUM]   5.00-6.00   sec   826 MBytes  6.92 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec   146 MBytes  1.22 Gbits/sec
[  6]   6.00-7.00   sec   150 MBytes  1.26 Gbits/sec
[  8]   6.00-7.00   sec   130 MBytes  1.09 Gbits/sec
[ 10]   6.00-7.00   sec   128 MBytes  1.07 Gbits/sec
[ 12]   6.00-7.00   sec   125 MBytes  1.05 Gbits/sec
[ 14]   6.00-7.00   sec   118 MBytes   989 Mbits/sec
[SUM]   6.00-7.00   sec   796 MBytes  6.69 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec   150 MBytes  1.26 Gbits/sec
[  6]   7.00-8.00   sec   164 MBytes  1.38 Gbits/sec
[  8]   7.00-8.00   sec   132 MBytes  1.11 Gbits/sec
[ 10]   7.00-8.00   sec   103 MBytes   863 Mbits/sec
[ 12]   7.00-8.00   sec   114 MBytes   952 Mbits/sec
[ 14]   7.00-8.00   sec   111 MBytes   932 Mbits/sec
[SUM]   7.00-8.00   sec   774 MBytes  6.49 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec   153 MBytes  1.28 Gbits/sec
[  6]   8.00-9.00   sec   155 MBytes  1.30 Gbits/sec
[  8]   8.00-9.00   sec   146 MBytes  1.23 Gbits/sec
[ 10]   8.00-9.00   sec   124 MBytes  1.04 Gbits/sec
[ 12]   8.00-9.00   sec   116 MBytes   976 Mbits/sec
[ 14]   8.00-9.00   sec   112 MBytes   939 Mbits/sec
[SUM]   8.00-9.00   sec   807 MBytes  6.76 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec   153 MBytes  1.28 Gbits/sec
[  6]   9.00-10.00  sec   145 MBytes  1.22 Gbits/sec
[  8]   9.00-10.00  sec   142 MBytes  1.20 Gbits/sec
[ 10]   9.00-10.00  sec   126 MBytes  1.06 Gbits/sec
[ 12]   9.00-10.00  sec   114 MBytes   953 Mbits/sec
[ 14]   9.00-10.00  sec   119 MBytes   995 Mbits/sec
[SUM]   9.00-10.00  sec   799 MBytes  6.70 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec  1.48 GBytes  1.27 Gbits/sec                  sender
[  4]   0.00-10.00  sec  1.48 GBytes  1.27 Gbits/sec                  receiver
[  6]   0.00-10.00  sec  1.46 GBytes  1.25 Gbits/sec                  sender
[  6]   0.00-10.00  sec  1.46 GBytes  1.25 Gbits/sec                  receiver
[  8]   0.00-10.00  sec  1.33 GBytes  1.14 Gbits/sec                  sender
[  8]   0.00-10.00  sec  1.33 GBytes  1.14 Gbits/sec                  receiver
[ 10]   0.00-10.00  sec  1.16 GBytes   996 Mbits/sec                  sender
[ 10]   0.00-10.00  sec  1.16 GBytes   996 Mbits/sec                  receiver
[ 12]   0.00-10.00  sec  1.11 GBytes   957 Mbits/sec                  sender
[ 12]   0.00-10.00  sec  1.11 GBytes   957 Mbits/sec                  receiver
[ 14]   0.00-10.00  sec  1.10 GBytes   946 Mbits/sec                  sender
[ 14]   0.00-10.00  sec  1.10 GBytes   946 Mbits/sec                  receiver
[SUM]   0.00-10.00  sec  7.64 GBytes  6.56 Gbits/sec                  sender
[SUM]   0.00-10.00  sec  7.64 GBytes  6.56 Gbits/sec                  receiver

 

iperf Done.

 

For p8,

 

C:\Users\Nepht\Downloads\iperf-3.1.3-win64>iperf3 -c 10.10.10.5 -P 8
Connecting to host 10.10.10.5, port 5201
[  4] local 10.10.10.10 port 50538 connected to 10.10.10.5 port 5201
[  6] local 10.10.10.10 port 50539 connected to 10.10.10.5 port 5201
[  8] local 10.10.10.10 port 50540 connected to 10.10.10.5 port 5201
[ 10] local 10.10.10.10 port 50541 connected to 10.10.10.5 port 5201
[ 12] local 10.10.10.10 port 50542 connected to 10.10.10.5 port 5201
[ 14] local 10.10.10.10 port 50543 connected to 10.10.10.5 port 5201
[ 16] local 10.10.10.10 port 50544 connected to 10.10.10.5 port 5201
[ 18] local 10.10.10.10 port 50545 connected to 10.10.10.5 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec   117 MBytes   981 Mbits/sec
[  6]   0.00-1.00   sec  95.2 MBytes   799 Mbits/sec
[  8]   0.00-1.00   sec  97.1 MBytes   815 Mbits/sec
[ 10]   0.00-1.00   sec  84.1 MBytes   706 Mbits/sec
[ 12]   0.00-1.00   sec  85.6 MBytes   718 Mbits/sec
[ 14]   0.00-1.00   sec  83.4 MBytes   699 Mbits/sec
[ 16]   0.00-1.00   sec  77.4 MBytes   649 Mbits/sec
[ 18]   0.00-1.00   sec  84.8 MBytes   711 Mbits/sec
[SUM]   0.00-1.00   sec   725 MBytes  6.08 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec   149 MBytes  1.25 Gbits/sec
[  6]   1.00-2.00   sec   126 MBytes  1.06 Gbits/sec
[  8]   1.00-2.00   sec   113 MBytes   948 Mbits/sec
[ 10]   1.00-2.00   sec   102 MBytes   859 Mbits/sec
[ 12]   1.00-2.00   sec  82.6 MBytes   693 Mbits/sec
[ 14]   1.00-2.00   sec  78.8 MBytes   661 Mbits/sec
[ 16]   1.00-2.00   sec  83.9 MBytes   704 Mbits/sec
[ 18]   1.00-2.00   sec  84.5 MBytes   709 Mbits/sec
[SUM]   1.00-2.00   sec   821 MBytes  6.88 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec   136 MBytes  1.15 Gbits/sec
[  6]   2.00-3.00   sec   127 MBytes  1.07 Gbits/sec
[  8]   2.00-3.00   sec   112 MBytes   944 Mbits/sec
[ 10]   2.00-3.00   sec   107 MBytes   899 Mbits/sec
[ 12]   2.00-3.00   sec  82.5 MBytes   692 Mbits/sec
[ 14]   2.00-3.00   sec  73.4 MBytes   616 Mbits/sec
[ 16]   2.00-3.00   sec  74.9 MBytes   628 Mbits/sec
[ 18]   2.00-3.00   sec  77.6 MBytes   651 Mbits/sec
[SUM]   2.00-3.00   sec   792 MBytes  6.64 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec   146 MBytes  1.22 Gbits/sec
[  6]   3.00-4.00   sec   131 MBytes  1.10 Gbits/sec
[  8]   3.00-4.00   sec   115 MBytes   967 Mbits/sec
[ 10]   3.00-4.00   sec   113 MBytes   945 Mbits/sec
[ 12]   3.00-4.00   sec  80.4 MBytes   674 Mbits/sec
[ 14]   3.00-4.00   sec  83.5 MBytes   700 Mbits/sec
[ 16]   3.00-4.00   sec  72.4 MBytes   607 Mbits/sec
[ 18]   3.00-4.00   sec  80.6 MBytes   676 Mbits/sec
[SUM]   3.00-4.00   sec   821 MBytes  6.89 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec   142 MBytes  1.19 Gbits/sec
[  6]   4.00-5.00   sec   133 MBytes  1.12 Gbits/sec
[  8]   4.00-5.00   sec   105 MBytes   878 Mbits/sec
[ 10]   4.00-5.00   sec   107 MBytes   897 Mbits/sec
[ 12]   4.00-5.00   sec  81.8 MBytes   686 Mbits/sec
[ 14]   4.00-5.00   sec  73.4 MBytes   616 Mbits/sec
[ 16]   4.00-5.00   sec  81.5 MBytes   684 Mbits/sec
[ 18]   4.00-5.00   sec  78.6 MBytes   660 Mbits/sec
[SUM]   4.00-5.00   sec   802 MBytes  6.73 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec   144 MBytes  1.21 Gbits/sec
[  6]   5.00-6.00   sec   141 MBytes  1.18 Gbits/sec
[  8]   5.00-6.00   sec   116 MBytes   971 Mbits/sec
[ 10]   5.00-6.00   sec   109 MBytes   915 Mbits/sec
[ 12]   5.00-6.00   sec  88.4 MBytes   741 Mbits/sec
[ 14]   5.00-6.00   sec  81.2 MBytes   682 Mbits/sec
[ 16]   5.00-6.00   sec  83.5 MBytes   701 Mbits/sec
[ 18]   5.00-6.00   sec  78.0 MBytes   654 Mbits/sec
[SUM]   5.00-6.00   sec   841 MBytes  7.05 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.00   sec   134 MBytes  1.12 Gbits/sec
[  6]   6.00-7.00   sec   124 MBytes  1.04 Gbits/sec
[  8]   6.00-7.00   sec   114 MBytes   958 Mbits/sec
[ 10]   6.00-7.00   sec   106 MBytes   888 Mbits/sec
[ 12]   6.00-7.00   sec  75.9 MBytes   636 Mbits/sec
[ 14]   6.00-7.00   sec  70.6 MBytes   592 Mbits/sec
[ 16]   6.00-7.00   sec  66.0 MBytes   554 Mbits/sec
[ 18]   6.00-7.00   sec  69.9 MBytes   586 Mbits/sec
[SUM]   6.00-7.00   sec   760 MBytes  6.38 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.00-8.00   sec   150 MBytes  1.26 Gbits/sec
[  6]   7.00-8.00   sec   137 MBytes  1.15 Gbits/sec
[  8]   7.00-8.00   sec   110 MBytes   919 Mbits/sec
[ 10]   7.00-8.00   sec   111 MBytes   928 Mbits/sec
[ 12]   7.00-8.00   sec  84.5 MBytes   709 Mbits/sec
[ 14]   7.00-8.00   sec  82.5 MBytes   692 Mbits/sec
[ 16]   7.00-8.00   sec  77.2 MBytes   648 Mbits/sec
[ 18]   7.00-8.00   sec  81.2 MBytes   682 Mbits/sec
[SUM]   7.00-8.00   sec   833 MBytes  6.99 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec   122 MBytes  1.02 Gbits/sec
[  6]   8.00-9.00   sec   126 MBytes  1.05 Gbits/sec
[  8]   8.00-9.00   sec   119 MBytes   997 Mbits/sec
[ 10]   8.00-9.00   sec   105 MBytes   877 Mbits/sec
[ 12]   8.00-9.00   sec  78.9 MBytes   661 Mbits/sec
[ 14]   8.00-9.00   sec  76.9 MBytes   645 Mbits/sec
[ 16]   8.00-9.00   sec  77.9 MBytes   653 Mbits/sec
[ 18]   8.00-9.00   sec  77.6 MBytes   651 Mbits/sec
[SUM]   8.00-9.00   sec   782 MBytes  6.56 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec   136 MBytes  1.14 Gbits/sec
[  6]   9.00-10.00  sec   131 MBytes  1.10 Gbits/sec
[  8]   9.00-10.00  sec   112 MBytes   944 Mbits/sec
[ 10]   9.00-10.00  sec  98.6 MBytes   827 Mbits/sec
[ 12]   9.00-10.00  sec  83.0 MBytes   696 Mbits/sec
[ 14]   9.00-10.00  sec  75.9 MBytes   637 Mbits/sec
[ 16]   9.00-10.00  sec  75.5 MBytes   633 Mbits/sec
[ 18]   9.00-10.00  sec  78.4 MBytes   658 Mbits/sec
[SUM]   9.00-10.00  sec   791 MBytes  6.64 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec  1.34 GBytes  1.15 Gbits/sec                  sender
[  4]   0.00-10.00  sec  1.34 GBytes  1.15 Gbits/sec                  receiver
[  6]   0.00-10.00  sec  1.24 GBytes  1.07 Gbits/sec                  sender
[  6]   0.00-10.00  sec  1.24 GBytes  1.07 Gbits/sec                  receiver
[  8]   0.00-10.00  sec  1.09 GBytes   934 Mbits/sec                  sender
[  8]   0.00-10.00  sec  1.09 GBytes   934 Mbits/sec                  receiver
[ 10]   0.00-10.00  sec  1.02 GBytes   874 Mbits/sec                  sender
[ 10]   0.00-10.00  sec  1.02 GBytes   874 Mbits/sec                  receiver
[ 12]   0.00-10.00  sec   824 MBytes   691 Mbits/sec                  sender
[ 12]   0.00-10.00  sec   823 MBytes   691 Mbits/sec                  receiver
[ 14]   0.00-10.00  sec   780 MBytes   654 Mbits/sec                  sender
[ 14]   0.00-10.00  sec   779 MBytes   654 Mbits/sec                  receiver
[ 16]   0.00-10.00  sec   770 MBytes   646 Mbits/sec                  sender
[ 16]   0.00-10.00  sec   770 MBytes   646 Mbits/sec                  receiver
[ 18]   0.00-10.00  sec   791 MBytes   664 Mbits/sec                  sender
[ 18]   0.00-10.00  sec   791 MBytes   664 Mbits/sec                  receiver
[SUM]   0.00-10.00  sec  7.78 GBytes  6.68 Gbits/sec                  sender
[SUM]   0.00-10.00  sec  7.78 GBytes  6.68 Gbits/sec                  receiver

 

iperf Done.