Jump to content

10Gb connection performance

TheTwist
By TheTwist
in Networking
 Share
Posted

I have a few computers with a 10Gb network card connected using Cat6a Ethernet cable to a 10G Switch then onto a NAS.

I wanted to see if I am getting the actual bandwidth, so i ran iperf 3  and it turns out i am only getting a maximum of 4GB/s  rather than 10GB/s

 

Any idea what could cause it? 

Link to comment
https://linustechtips.com/topic/1109278-10gb-connection-performance/
Share on other sites
Link to post
Share on other sites
Posted
  • Author
12 minutes ago, UrbanFreestyle said:

Drives will not run at the speed of the sata connection, Combine into raid and increase speeds.... still not going to run at 6Gb/s

 

Also i assume that you mean it's running at 4Gb/ not 4GB/s

snip.JPG

I re did a test and it is actually  2.12Gbits/Sec the bandwidth and 252 MBytes for  transfer speed.

 

Does that seem right for a 10g connection or is there a way to improve 

 

connectspeed.PNG

Link to post
Share on other sites
Posted

I doubt that the problem is the storage. sata does limit to 6 Gigabit/Second, but iPerf doesn't need the storage and you are getting 2 Gigabits. What CPUs does the PC and NAS have? how long are the cables? maybe check some settings?

 

btw I am guessing that the computer is connected directly to the nas and that it has a different cable to access the internet

Link to post
Share on other sites
Posted
  • Author
13 hours ago, mtz_federico said:

I doubt that the problem is the storage. sata does limit to 6 Gigabit/Second, but iPerf doesn't need the storage and you are getting 2 Gigabits. What CPUs does the PC and NAS have? how long are the cables? maybe check some settings?

 

btw I am guessing that the computer is connected directly to the nas and that it has a different cable to access the internet

 

NAS - INTEL Xeon D-1521

PC - INTEL Xeron E5-2630 v4

 

It is all going through the same cable. 

Link to post
Share on other sites
Posted
19 hours ago, mtz_federico said:

sata does limit to 6 Gigabit/Second

That's irrelevant, an HDD has no chance of getting even close to saturating the SATA link in the first place.

 

What NAS and how many of those 4TB drives?

A single standard HDD typically runs 100-150MB/s max aka 1Gbit or so. 

To saturate a 10Gb link with HDDs you need a mighty array of probably 10-12 drives given the overhead, and a controller that's able to juggle with that amount of data.

 

Your data would look normal for a 2-drive setup.

 

EDIT: Didn't see that the network itself is slow given iperf. Still the storage considerations matter.

 

What are the 10G cards, and are they plugged in slots with enough lanes?

F@H
Desktop: i9-13900K, ASUS Z790-E, 64GB DDR5-6000 CL36, RTX3080, 2TB MP600 Pro XT, 2TB SX8200Pro, 2x16TB Ironwolf RAID0, Corsair HX1200, Antec Vortex 360 AIO, Thermaltake Versa H25 TG, Samsung 4K curved 49" TV, 23" secondary, Mountain Everest Max

Mobile SFF rig: i9-9900K, Noctua NH-L9i, Asrock Z390 Phantom ITX-AC, 32GB, GTX1070, 2x1TB SX8200Pro RAID0, 2x5TB 2.5" HDD RAID0, Athena 500W Flex (Noctua fan), Custom 4.7l 3D printed case

 

Asus Zenbook UM325UA, Ryzen 7 5700u, 16GB, 1TB, OLED

 

GPD Win 2

Link to post
Share on other sites
Posted
  • Author
17 minutes ago, mtz_federico said:

So you are using a switch. What switch? is it managed?

Yes it is managed. 

 

3 minutes ago, Kilrah said:

That's irrelevant, an HDD has no chance of getting even close to saturating the SATA link in the first place.

 

What NAS and how many of those 4TB drives?

A single standard HDD typically runs 100-150MB/s max aka 1Gbit or so. 

To saturate a 10Gb link with HDDs you need a mighty array of probably 10-12 drives given the overhead, and a controller that's able to juggle with that amount of data.

 

Your data would look normal for a 2-drive setup.

We have a Synology RS3617RPxs with 20000 Mbps  and 8 of the 4TB

Link to post
Share on other sites
Posted
  • Author
11 minutes ago, mynameisjuan said:

Looking at the iPerf, what are your subnets? Unless you changed it to a /23 then you're now routing, not switching.

Our subnet is on a /22  had to change from a /24  because the amount of addresses that was needed at the time.

 

Edit: So all servers / switches and other fixed on 192.168.0.X and DHCP are on 192.168.1.X

Link to post
Share on other sites
Posted
14 minutes ago, TheTwist said:

Our subnet is on a /22  had to change from a /24  because the amount of addresses that was needed at the time.

 

Edit: So all servers / switches and other fixed on 192.168.0.X and DHCP are on 192.168.1.X

Ok, so also you're going to need to bump up the parallel streams to get 10gig. I think the command was -P [#]. Try 5 or 10 streams first

Link to post
Share on other sites
Posted
  • Author
57 minutes ago, mynameisjuan said:

Ok, so also you're going to need to bump up the parallel streams to get 10gig. I think the command was -P [#]. Try 5 or 10 streams first

 

Ok so here is it at parallel streams 10. That give a total of 10G 

parra10.PNG

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
 Share
Go to topic listing Networking

×