10GBE HELP (Problem)

[DreedX]

Hello there, I'm having problems with 10gbe, I recently purchased a Synology NAS 1819+ with the dual 10gbe network card from Synology, I also purchased the Synology single 10gbe port thinking it would work out of the bat in the computer, results it won't, even if it said that it was Windows 10 supported, I worked around this finding out the chip this single port card uses is Aquantia so I downloaded these drivers and my card was recognized, now, my Nas has 4 x 12TB seagate Firewolf Pro in SHR with 1 fault disk tolerance. And the rest is 1 read cache ssd for this array and another Raid 0 of 3x Samsung SSD. 2 Computers are connected to the NAS directly with Cat 8 cable. Results I do an iperf test and my speeds won't go over 5gb/s on one computer, and 3gb/s on the other. Asuming the PCI port speed is in play, I know one is running at 4x and the other computer at 8x, but its never reaching more than those 3gb/s or 5gb/s, I have enabled Jumbo Frames and everything. These are my speed test on write and read. Should I be looking at something better? Will I get better speeds if I change my network cards on the computers? I have seen people getting way higher speeds with spinning disks.

Thanks

SSD Raid 0 | Speeds 769.0 Write / 607.8 Read

 

 

SHR 32TB | 442.3 Write / 308.3 Read

 

[Kilrah]

These speeds look normal for 3 HDDs (not counting the redundant one, it's not helping for transfer speeds). They'll be the limit at about 200-250MB/s a piece, not the 10G network. 

 

You can have better speeds with spinning disks, as long as you put more of them...

[Alex Atkin UK]

Were you using iperf or iperf3 for testing?

 

On Linux between an Aquantia and an Intel card using iperf3 I get the following WITHOUT jumbo frames:

 

Quote

[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec  1.09 GBytes  9.39 Gbits/sec                  
[  5]   1.00-2.00   sec  1.09 GBytes  9.40 Gbits/sec                  
[  5]   2.00-3.00   sec  1.10 GBytes  9.41 Gbits/sec                  
[  5]   3.00-4.00   sec  1.09 GBytes  9.39 Gbits/sec                  
[  5]   4.00-5.00   sec  1.09 GBytes  9.36 Gbits/sec                  
[  5]   5.00-6.00   sec  1.09 GBytes  9.40 Gbits/sec                  
[  5]   6.00-7.00   sec  1.09 GBytes  9.39 Gbits/sec                  
[  5]   7.00-8.00   sec  1.09 GBytes  9.40 Gbits/sec                  
[  5]   8.00-9.00   sec  1.09 GBytes  9.39 Gbits/sec                  
[  5]   9.00-10.00  sec  1.09 GBytes  9.41 Gbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec  10.9 GBytes  9.39 Gbits/sec    0             sender
[  5]   0.00-10.00  sec  10.9 GBytes  9.39 Gbits/sec                  receiver

With a 9000 MTU:

Quote

[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec  1.13 GBytes  9.72 Gbits/sec                  
[  5]   1.00-2.00   sec  1.15 GBytes  9.90 Gbits/sec                  
[  5]   2.00-3.00   sec  1.15 GBytes  9.90 Gbits/sec                  
[  5]   3.00-4.00   sec  1.15 GBytes  9.89 Gbits/sec                  
[  5]   4.00-5.00   sec  1.15 GBytes  9.87 Gbits/sec                  
[  5]   5.00-6.00   sec  1.15 GBytes  9.88 Gbits/sec                  
[  5]   6.00-7.00   sec  1.15 GBytes  9.90 Gbits/sec                  
[  5]   7.00-8.00   sec  1.15 GBytes  9.90 Gbits/sec                  
[  5]   8.00-9.00   sec  1.15 GBytes  9.90 Gbits/sec                  
[  5]   9.00-10.00  sec  1.15 GBytes  9.90 Gbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec  11.5 GBytes  9.88 Gbits/sec    0             sender
[  5]   0.00-10.00  sec  11.5 GBytes  9.87 Gbits/sec                  receiver

This is through two switches, two sets of CAT6 cables and a DAC from the main switch to my NAS/server (self built).

If you can't get it to work, as silly as it sounds I'd try a CAT6 cable.  I'm not convinced the CAT8 cables being sold are legitimate as there isn't really any use case for them right now.

[Kilrah]

And also just look at the connection properties if it really sees a 10G link in the first place.

[beersykins]

What specific card did you get?  If it's an 8x card for 10G it sounds way old.

[Alex Atkin UK]

2 hours ago, beersykins said:

What specific card did you get?  If it's an 8x card for 10G it sounds way old.

Shouldn't really matter though, the older cards are more likely to be intended for data centres so very robust chipsets.

 

The Intel card I have in my NAS is 8x because its SFP+ and there seems to have been an "if it aint broke, don't fix it" attitude.  The chipset has been out since 2010 but the card was actually manufactured in 2018.  Even if it fell back to PCIe 2.0 x4 you should be able to hit 10G in one direction, just not in both at the same time.

[Kilrah]

He said he got Synology cards, 1 single port and one double port - there's only one of each.

https://www.synology.com/en-global/products/accessories/add_in