Jump to content

10Gbe problem please help

Bmoney
By Bmoney
in Networking
 Share
Posted

Computer 1 (Client): Asus Rampage IV Extreme. i-7900K, 16GB ram, 1080ti, 960evo ssd. Windows 10
Computer 2 (Server): Zenith Extreme II, Treadripper 2950X, 64GB ECC ram, 780ti, 2x raidz2 of 12x 8tb drives, 970evo 1tb ssd. Ubuntu 20

Each computer has there own 1gbe connect to internet and P2P on 10gbe directly to each other. 
 

iperf has ok connect from PC1 to PC2
Server listening on 5201
-----------------------------------------------------------
Accepted connection from 10.2.2.1, port 58668
[  5] local 10.2.2.3 port 5201 connected to 10.2.2.1 port 58670
[ ID] Interval           Transfer     Bandwidth
[  5]   0.00-1.00   sec   956 MBytes  8.02 Gbits/sec
[  5]   1.00-2.00   sec   959 MBytes  8.04 Gbits/sec
[  5]   2.00-3.00   sec   962 MBytes  8.07 Gbits/sec
[  5]   3.00-4.00   sec   962 MBytes  8.07 Gbits/sec
[  5]   4.00-5.00   sec   979 MBytes  8.21 Gbits/sec
[  5]   5.00-6.00   sec   972 MBytes  8.16 Gbits/sec
[  5]   6.00-7.00   sec   974 MBytes  8.17 Gbits/sec
[  5]   7.00-8.00   sec   972 MBytes  8.16 Gbits/sec
[  5]   8.00-9.00   sec   962 MBytes  8.07 Gbits/sec
[  5]   9.00-10.00  sec   961 MBytes  8.06 Gbits/sec
[  5]  10.00-10.00  sec  0.00 Bytes  0.00 bits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  5]   0.00-10.00  sec  0.00 Bytes  0.00 bits/sec                  sender
[  5]   0.00-10.00  sec  9.43 GBytes  8.10 Gbits/sec

Although 10Gbe should be 9.4Gbits/s unfettered

Problems from PC2 to PC1

Connecting to host 10.2.2.1, port 5201
[  4] local 10.2.2.3 port 55244 connected to 10.2.2.1 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec   236 MBytes  1.98 Gbits/sec
[  4]   1.00-2.01   sec   104 MBytes   858 Mbits/sec
[  4]   2.01-3.01   sec  94.0 MBytes   794 Mbits/sec
[  4]   3.01-4.00   sec   138 MBytes  1.17 Gbits/sec
[  4]   4.00-5.00   sec  48.1 MBytes   403 Mbits/sec
[  4]   5.00-6.00   sec   204 MBytes  1.71 Gbits/sec
[  4]   6.00-7.00   sec  64.1 MBytes   540 Mbits/sec
[  4]   7.00-8.01   sec  8.75 MBytes  72.3 Mbits/sec
[  4]   8.01-9.01   sec  98.0 MBytes   824 Mbits/sec
[  4]   9.01-10.01  sec  31.9 MBytes   267 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.01  sec  1.00 GBytes   861 Mbits/sec                  sender
[  4]   0.00-10.01  sec  1.00 GBytes   861 Mbits/sec                  receiver

Why is this happening?
Here is Ubuntu ifconfig. 


enp9s0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 10.2.2.1  netmask 255.255.255.0  broadcast 10.2.2.255
        inet6 fe80::42b0:76ff:fed7:f029  prefixlen 64  scopeid 0x20<link>
        ether 40:b0:76:d7:f0:29  txqueuelen 10000  (Ethernet)
        RX packets 2798990  bytes 3486031645 (3.4 GB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 7477093  bytes 10843502915 (10.8 GB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

Windows machine has jumbo packets enabled. I tried to disable all offload features. Didn't help.
I was worried about ZFS speeds but from internal sdd zfs speed are great. So it seems a network issue. 
What is the issue. What is causes the limit in to the server?


                

Link to comment
https://linustechtips.com/topic/1235571-10gbe-problem-please-help/
Share on other sites
Link to post
Share on other sites
Posted
  • Author
4 minutes ago, Electronics Wizardy said:

this makes me tthinks the ubuntu box isn't using jumbo pckets. Check that the mtu is set to the same on both.

Connecting to host 10.2.2.1, port 5201
[  4] local 10.2.2.3 port 57686 connected to 10.2.2.1 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.01   sec   239 MBytes  1.99 Gbits/sec
[  4]   1.01-2.01   sec  0.00 Bytes  0.00 bits/sec
[  4]   2.01-3.00   sec  0.00 Bytes  0.00 bits/sec
[  4]   3.00-4.01   sec  0.00 Bytes  0.00 bits/sec
[  4]   4.01-5.01   sec  0.00 Bytes  0.00 bits/sec
[  4]   5.01-6.01   sec  0.00 Bytes  0.00 bits/sec
[  4]   6.01-7.01   sec  0.00 Bytes  0.00 bits/sec
[  4]   7.01-8.01   sec  0.00 Bytes  0.00 bits/sec
[  4]   8.01-9.01   sec  0.00 Bytes  0.00 bits/sec
[  4]   9.01-10.01  sec  0.00 Bytes  0.00 bits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.01  sec   239 MBytes   200 Mbits/sec                  sender
[  4]   0.00-10.01  sec   239 MBytes   200 Mbits/sec                  receiver

iperf Done.

Changed the MTU to 9000(That keeps resetting on reboot)

now it is worse

Link to post
Share on other sites
Posted
2 minutes ago, Bmoney said:

Connecting to host 10.2.2.1, port 5201
[  4] local 10.2.2.3 port 57686 connected to 10.2.2.1 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.01   sec   239 MBytes  1.99 Gbits/sec
[  4]   1.01-2.01   sec  0.00 Bytes  0.00 bits/sec
[  4]   2.01-3.00   sec  0.00 Bytes  0.00 bits/sec
[  4]   3.00-4.01   sec  0.00 Bytes  0.00 bits/sec
[  4]   4.01-5.01   sec  0.00 Bytes  0.00 bits/sec
[  4]   5.01-6.01   sec  0.00 Bytes  0.00 bits/sec
[  4]   6.01-7.01   sec  0.00 Bytes  0.00 bits/sec
[  4]   7.01-8.01   sec  0.00 Bytes  0.00 bits/sec
[  4]   8.01-9.01   sec  0.00 Bytes  0.00 bits/sec
[  4]   9.01-10.01  sec  0.00 Bytes  0.00 bits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.01  sec   239 MBytes   200 Mbits/sec                  sender
[  4]   0.00-10.01  sec   239 MBytes   200 Mbits/sec                  receiver

iperf Done.

Changed the MTU to 9000(That keeps resetting on reboot)

now it is worse

what if you default the mtu to 1500 again on both of them? You should be able to hit 9+gibt on 1500

Link to post
Share on other sites
Posted
  • Author

Connecting to host 10.2.2.1, port 5201
[  4] local 10.2.2.3 port 50555 connected to 10.2.2.1 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec   162 MBytes  1.36 Gbits/sec
[  4]   1.00-2.00   sec   157 MBytes  1.32 Gbits/sec
[  4]   2.00-3.00   sec   218 MBytes  1.82 Gbits/sec
[  4]   3.00-4.01   sec   141 MBytes  1.17 Gbits/sec
[  4]   4.01-5.00   sec  59.8 MBytes   508 Mbits/sec
[  4]   5.00-6.00   sec   240 MBytes  2.01 Gbits/sec
[  4]   6.00-7.01   sec  78.9 MBytes   653 Mbits/sec
[  4]   7.01-8.01   sec  0.00 Bytes  0.00 bits/sec
[  4]   8.01-9.00   sec   165 MBytes  1.39 Gbits/sec
[  4]   9.00-10.00  sec   206 MBytes  1.73 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec  1.39 GBytes  1.20 Gbits/sec                  sender
[  4]   0.00-10.00  sec  1.39 GBytes  1.20 Gbits/sec                  receiver

Jumbo Packet disable on windows and Ubuntu set to 1500. Still shit.

9 minutes ago, Electronics Wizardy said:

this makes me tthinks the ubuntu box isn't using jumbo pckets. Check that the mtu is set to the same on both.

Connecting to host 10.2.2.1, port 5201
[  4] local 10.2.2.3 port 57686 connected to 10.2.2.1 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.01   sec   239 MBytes  1.99 Gbits/sec
[  4]   1.01-2.01   sec  0.00 Bytes  0.00 bits/sec
[  4]   2.01-3.00   sec  0.00 Bytes  0.00 bits/sec
[  4]   3.00-4.01   sec  0.00 Bytes  0.00 bits/sec
[  4]   4.01-5.01   sec  0.00 Bytes  0.00 bits/sec
[  4]   5.01-6.01   sec  0.00 Bytes  0.00 bits/sec
[  4]   6.01-7.01   sec  0.00 Bytes  0.00 bits/sec
[  4]   7.01-8.01   sec  0.00 Bytes  0.00 bits/sec
[  4]   8.01-9.01   sec  0.00 Bytes  0.00 bits/sec
[  4]   9.01-10.01  sec  0.00 Bytes  0.00 bits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.01  sec   239 MBytes   200 Mbits/sec                  sender
[  4]   0.00-10.01  sec   239 MBytes   200 Mbits/sec                  receiver

iperf Done.

Changed the MTU to 9000(That keeps resetting on reboot)

now it is worse

Link to post
Share on other sites
Posted
3 minutes ago, Bmoney said:

Connecting to host 10.2.2.1, port 5201
[  4] local 10.2.2.3 port 50555 connected to 10.2.2.1 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec   162 MBytes  1.36 Gbits/sec
[  4]   1.00-2.00   sec   157 MBytes  1.32 Gbits/sec
[  4]   2.00-3.00   sec   218 MBytes  1.82 Gbits/sec
[  4]   3.00-4.01   sec   141 MBytes  1.17 Gbits/sec
[  4]   4.01-5.00   sec  59.8 MBytes   508 Mbits/sec
[  4]   5.00-6.00   sec   240 MBytes  2.01 Gbits/sec
[  4]   6.00-7.01   sec  78.9 MBytes   653 Mbits/sec
[  4]   7.01-8.01   sec  0.00 Bytes  0.00 bits/sec
[  4]   8.01-9.00   sec   165 MBytes  1.39 Gbits/sec
[  4]   9.00-10.00  sec   206 MBytes  1.73 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec  1.39 GBytes  1.20 Gbits/sec                  sender
[  4]   0.00-10.00  sec  1.39 GBytes  1.20 Gbits/sec                  receiver

Jumbo Packet disable on windows and Ubuntu set to 1500. Still shit.

Connecting to host 10.2.2.1, port 5201
[  4] local 10.2.2.3 port 57686 connected to 10.2.2.1 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.01   sec   239 MBytes  1.99 Gbits/sec
[  4]   1.01-2.01   sec  0.00 Bytes  0.00 bits/sec
[  4]   2.01-3.00   sec  0.00 Bytes  0.00 bits/sec
[  4]   3.00-4.01   sec  0.00 Bytes  0.00 bits/sec
[  4]   4.01-5.01   sec  0.00 Bytes  0.00 bits/sec
[  4]   5.01-6.01   sec  0.00 Bytes  0.00 bits/sec
[  4]   6.01-7.01   sec  0.00 Bytes  0.00 bits/sec
[  4]   7.01-8.01   sec  0.00 Bytes  0.00 bits/sec
[  4]   8.01-9.01   sec  0.00 Bytes  0.00 bits/sec
[  4]   9.01-10.01  sec  0.00 Bytes  0.00 bits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.01  sec   239 MBytes   200 Mbits/sec                  sender
[  4]   0.00-10.01  sec   239 MBytes   200 Mbits/sec                  receiver

iperf Done.

Changed the MTU to 9000(That keeps resetting on reboot)

now it is worse

FOr the first test how many parallel streams are you using?

 

What nics are you usig? Are they running too hot? What if you swp the nics betwen sytems?

Link to post
Share on other sites
Posted
  • Author
28 minutes ago, Electronics Wizardy said:

FOr the first test how many parallel streams are you using?

 

What nics are you usig? Are they running too hot? What if you swp the nics betwen sytems?

The NICs are built into the motherboards. 
Not hot. 
Excuse my ignorance on parallel streams?

Link to post
Share on other sites
Posted
29 minutes ago, Bmoney said:

The NICs are built into the motherboards. 
Not hot. 
Excuse my ignorance on parallel streams?

the -P option in iperf will have multile streams at once, sometimes your cpu limited or something so a single tcp stream can only be so fsat.

Link to post
Share on other sites
Posted
  • Author
2 minutes ago, Electronics Wizardy said:

the -P option in iperf will have multile streams at once, sometimes your cpu limited or something so a single tcp stream can only be so fsat.

Connecting to host 10.2.2.1, port 5201
[  4] local 10.2.2.3 port 60531 connected to 10.2.2.1 port 5201
[  6] local 10.2.2.3 port 60532 connected to 10.2.2.1 port 5201
[  8] local 10.2.2.3 port 60533 connected to 10.2.2.1 port 5201
[ 10] local 10.2.2.3 port 60534 connected to 10.2.2.1 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  67.0 MBytes   562 Mbits/sec
[  6]   0.00-1.00   sec   148 MBytes  1.24 Gbits/sec
[  8]   0.00-1.00   sec   149 MBytes  1.25 Gbits/sec
[ 10]   0.00-1.00   sec  94.2 MBytes   790 Mbits/sec
[SUM]   0.00-1.00   sec   458 MBytes  3.84 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec   104 MBytes   868 Mbits/sec
[  6]   1.00-2.00   sec   135 MBytes  1.13 Gbits/sec
[  8]   1.00-2.00   sec  72.6 MBytes   609 Mbits/sec
[ 10]   1.00-2.00   sec  60.9 MBytes   511 Mbits/sec
[SUM]   1.00-2.00   sec   372 MBytes  3.12 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec   156 MBytes  1.30 Gbits/sec
[  6]   2.00-3.00   sec  97.4 MBytes   817 Mbits/sec
[  8]   2.00-3.00   sec  17.2 MBytes   145 Mbits/sec
[ 10]   2.00-3.00   sec  74.9 MBytes   628 Mbits/sec
[SUM]   2.00-3.00   sec   345 MBytes  2.89 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  78.1 MBytes   655 Mbits/sec
[  6]   3.00-4.00   sec   114 MBytes   959 Mbits/sec
[  8]   3.00-4.00   sec   157 MBytes  1.32 Gbits/sec
[ 10]   3.00-4.00   sec   138 MBytes  1.16 Gbits/sec
[SUM]   3.00-4.00   sec   487 MBytes  4.09 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  1.88 MBytes  15.7 Mbits/sec
[  6]   4.00-5.00   sec  52.9 MBytes   444 Mbits/sec
[  8]   4.00-5.00   sec  49.1 MBytes   412 Mbits/sec
[ 10]   4.00-5.00   sec  80.6 MBytes   676 Mbits/sec
[SUM]   4.00-5.00   sec   184 MBytes  1.55 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  0.00 Bytes  0.00 bits/sec
[  6]   5.00-6.00   sec  71.4 MBytes   599 Mbits/sec
[  8]   5.00-6.00   sec   110 MBytes   925 Mbits/sec
[ 10]   5.00-6.00   sec  83.1 MBytes   697 Mbits/sec
[SUM]   5.00-6.00   sec   265 MBytes  2.22 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.01   sec   164 MBytes  1.37 Gbits/sec
[  6]   6.00-7.01   sec  25.4 MBytes   212 Mbits/sec
[  8]   6.00-7.01   sec   160 MBytes  1.33 Gbits/sec
[ 10]   6.00-7.01   sec  8.12 MBytes  67.8 Mbits/sec
[SUM]   6.00-7.01   sec   357 MBytes  2.98 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.01-8.00   sec  12.8 MBytes   108 Mbits/sec
[  6]   7.01-8.00   sec  83.8 MBytes   707 Mbits/sec
[  8]   7.01-8.00   sec   168 MBytes  1.42 Gbits/sec
[ 10]   7.01-8.00   sec  90.0 MBytes   760 Mbits/sec
[SUM]   7.01-8.00   sec   355 MBytes  2.99 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  18.0 MBytes   151 Mbits/sec
[  6]   8.00-9.00   sec  52.1 MBytes   437 Mbits/sec
[  8]   8.00-9.00   sec  84.4 MBytes   708 Mbits/sec
[ 10]   8.00-9.00   sec  26.5 MBytes   222 Mbits/sec
[SUM]   8.00-9.00   sec   181 MBytes  1.52 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  52.1 MBytes   437 Mbits/sec
[  6]   9.00-10.00  sec   101 MBytes   845 Mbits/sec
[  8]   9.00-10.00  sec   157 MBytes  1.32 Gbits/sec
[ 10]   9.00-10.00  sec  78.0 MBytes   654 Mbits/sec
[SUM]   9.00-10.00  sec   388 MBytes  3.25 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec   653 MBytes   548 Mbits/sec                  sender
[  4]   0.00-10.00  sec   653 MBytes   547 Mbits/sec                  receiver
[  6]   0.00-10.00  sec   880 MBytes   739 Mbits/sec                  sender
[  6]   0.00-10.00  sec   880 MBytes   738 Mbits/sec                  receiver
[  8]   0.00-10.00  sec  1.10 GBytes   944 Mbits/sec                  sender
[  8]   0.00-10.00  sec  1.10 GBytes   944 Mbits/sec                  receiver
[ 10]   0.00-10.00  sec   734 MBytes   616 Mbits/sec                  sender
[ 10]   0.00-10.00  sec   734 MBytes   616 Mbits/sec                  receiver
[SUM]   0.00-10.00  sec  3.31 GBytes  2.85 Gbits/sec                  sender
[SUM]   0.00-10.00  sec  3.31 GBytes  2.85 Gbits/sec                  receiver

Tried 4 streams better but what is stopping multiple streams on setup?

Link to post
Share on other sites
Posted
  • Author
1 minute ago, Bmoney said:

Connecting to host 10.2.2.1, port 5201
[  4] local 10.2.2.3 port 60531 connected to 10.2.2.1 port 5201
[  6] local 10.2.2.3 port 60532 connected to 10.2.2.1 port 5201
[  8] local 10.2.2.3 port 60533 connected to 10.2.2.1 port 5201
[ 10] local 10.2.2.3 port 60534 connected to 10.2.2.1 port 5201
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-1.00   sec  67.0 MBytes   562 Mbits/sec
[  6]   0.00-1.00   sec   148 MBytes  1.24 Gbits/sec
[  8]   0.00-1.00   sec   149 MBytes  1.25 Gbits/sec
[ 10]   0.00-1.00   sec  94.2 MBytes   790 Mbits/sec
[SUM]   0.00-1.00   sec   458 MBytes  3.84 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   1.00-2.00   sec   104 MBytes   868 Mbits/sec
[  6]   1.00-2.00   sec   135 MBytes  1.13 Gbits/sec
[  8]   1.00-2.00   sec  72.6 MBytes   609 Mbits/sec
[ 10]   1.00-2.00   sec  60.9 MBytes   511 Mbits/sec
[SUM]   1.00-2.00   sec   372 MBytes  3.12 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   2.00-3.00   sec   156 MBytes  1.30 Gbits/sec
[  6]   2.00-3.00   sec  97.4 MBytes   817 Mbits/sec
[  8]   2.00-3.00   sec  17.2 MBytes   145 Mbits/sec
[ 10]   2.00-3.00   sec  74.9 MBytes   628 Mbits/sec
[SUM]   2.00-3.00   sec   345 MBytes  2.89 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   3.00-4.00   sec  78.1 MBytes   655 Mbits/sec
[  6]   3.00-4.00   sec   114 MBytes   959 Mbits/sec
[  8]   3.00-4.00   sec   157 MBytes  1.32 Gbits/sec
[ 10]   3.00-4.00   sec   138 MBytes  1.16 Gbits/sec
[SUM]   3.00-4.00   sec   487 MBytes  4.09 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   4.00-5.00   sec  1.88 MBytes  15.7 Mbits/sec
[  6]   4.00-5.00   sec  52.9 MBytes   444 Mbits/sec
[  8]   4.00-5.00   sec  49.1 MBytes   412 Mbits/sec
[ 10]   4.00-5.00   sec  80.6 MBytes   676 Mbits/sec
[SUM]   4.00-5.00   sec   184 MBytes  1.55 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   5.00-6.00   sec  0.00 Bytes  0.00 bits/sec
[  6]   5.00-6.00   sec  71.4 MBytes   599 Mbits/sec
[  8]   5.00-6.00   sec   110 MBytes   925 Mbits/sec
[ 10]   5.00-6.00   sec  83.1 MBytes   697 Mbits/sec
[SUM]   5.00-6.00   sec   265 MBytes  2.22 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   6.00-7.01   sec   164 MBytes  1.37 Gbits/sec
[  6]   6.00-7.01   sec  25.4 MBytes   212 Mbits/sec
[  8]   6.00-7.01   sec   160 MBytes  1.33 Gbits/sec
[ 10]   6.00-7.01   sec  8.12 MBytes  67.8 Mbits/sec
[SUM]   6.00-7.01   sec   357 MBytes  2.98 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   7.01-8.00   sec  12.8 MBytes   108 Mbits/sec
[  6]   7.01-8.00   sec  83.8 MBytes   707 Mbits/sec
[  8]   7.01-8.00   sec   168 MBytes  1.42 Gbits/sec
[ 10]   7.01-8.00   sec  90.0 MBytes   760 Mbits/sec
[SUM]   7.01-8.00   sec   355 MBytes  2.99 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   8.00-9.00   sec  18.0 MBytes   151 Mbits/sec
[  6]   8.00-9.00   sec  52.1 MBytes   437 Mbits/sec
[  8]   8.00-9.00   sec  84.4 MBytes   708 Mbits/sec
[ 10]   8.00-9.00   sec  26.5 MBytes   222 Mbits/sec
[SUM]   8.00-9.00   sec   181 MBytes  1.52 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[  4]   9.00-10.00  sec  52.1 MBytes   437 Mbits/sec
[  6]   9.00-10.00  sec   101 MBytes   845 Mbits/sec
[  8]   9.00-10.00  sec   157 MBytes  1.32 Gbits/sec
[ 10]   9.00-10.00  sec  78.0 MBytes   654 Mbits/sec
[SUM]   9.00-10.00  sec   388 MBytes  3.25 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth
[  4]   0.00-10.00  sec   653 MBytes   548 Mbits/sec                  sender
[  4]   0.00-10.00  sec   653 MBytes   547 Mbits/sec                  receiver
[  6]   0.00-10.00  sec   880 MBytes   739 Mbits/sec                  sender
[  6]   0.00-10.00  sec   880 MBytes   738 Mbits/sec                  receiver
[  8]   0.00-10.00  sec  1.10 GBytes   944 Mbits/sec                  sender
[  8]   0.00-10.00  sec  1.10 GBytes   944 Mbits/sec                  receiver
[ 10]   0.00-10.00  sec   734 MBytes   616 Mbits/sec                  sender
[ 10]   0.00-10.00  sec   734 MBytes   616 Mbits/sec                  receiver
[SUM]   0.00-10.00  sec  3.31 GBytes  2.85 Gbits/sec                  sender
[SUM]   0.00-10.00  sec  3.31 GBytes  2.85 Gbits/sec                  receiver

Tried 4 streams better but what is stopping multiple streams on setup?

I also did 40 streams and finally maxed out the connection.

Link to post
Share on other sites
Posted
  • Author

[ 82]   0.00-10.00  sec   221 MBytes   185 Mbits/sec                  receiver
[SUM]   0.00-10.00  sec  10.9 GBytes  9.35 Gbits/sec                  sender
[SUM]   0.00-10.00  sec  10.9 GBytes  9.35 Gbits/sec                  receiver
 

Link to post
Share on other sites
  • 1 month later...
Posted
  • Author
On 8/17/2020 at 6:11 PM, Electronics Wizardy said:

the -P option in iperf will have multile streams at once, sometimes your cpu limited or something so a single tcp stream can only be so fsat.


So from that.
Storage not the issue.
Hardware is not the issue. 
It clearly is configuration right?

Link to post
Share on other sites
Posted
On 9/22/2020 at 12:30 PM, Bmoney said:


So from that.
Storage not the issue.
Hardware is not the issue. 
It clearly is configuration right?

yea seems to be a config issue. Is smb multichannel being used, it can help a good amount here.

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
 Share
Go to topic listing Networking

×