Jump to content
Search In
  • More options...
Find results that contain...
Find results in...
WizPip

Trying to get 2GB/s on one PC out of 2x 10GbE ports

Recommended Posts

Posted · Original PosterOP

Hey team!

 

I have two Win10 based machines, each with a twin 10GbE port Intel X550 adapter. These are all connected (4 wires total) to a 10GbE switch.

 

I fell down a huge number of rabbit holes before coming to the SMB Multichannel conclusion, which annoyingly mostly "just works". (For the love of god, avoid link aggregation if you just want speed!)

 

So, I'm at the point where I'm up to 1.3GB/s transfer speeds, but I want as close to the full 20Gbit (2.5GB theoretical maximum) possible. I have confirmed that during a file transfer both ports on both machines are all active and sending data at balanced speeds. Crystal disk mark says the M.2 in one machine and 5x 1TB SSDs in a simple Storage Space with 5 columns in the other are all capable of > 2GB/s read / write speeds... so what do I have left to poke to improve the speed?

 

Here are some pics which may answer some questions you may have...

NAS.png

NAS

 

PC.png

PC

 

Transfer.png

Transfer from NAS

 

rss.PNG

RSS CPU config

 

PC during copy.png

PC during transfer

 

NAS during copy.png

NAS during transfer

 

Some more SMB config below:

smb-clientconfig.PNG

smb-clientnetwork.PNG

smb-serverconfig.PNG

smb-servernetint.PNG

 

switch.PNG

Switch

 

NIC config (all 4 identical) below:

nic-jumbo.png

nic-receivebuff.png

nic-rss.png

nic-rssqueues.png

nic-transmitbuff.png

Link to post
Share on other sites

Z97 chipset only runs PCIe 2.0, if you write to a drive on that then you'll get a 2GB/s cap from there. Maybe something else is hogging transfer at the same time?


CPU: i7-2600K 4751MHz 1.44V (software) --> 1.47V at the back of the socket Motherboard: Asrock Z77 Extreme4 (BCLK: 103.3MHz) CPU Cooler: Noctua NH-D15 RAM: Adata XPG 2x8GB DDR3 (XMP: 2133MHz 10-11-11-30 CR2, custom: 2203MHz 10-11-10-26 CR1 tRFC:230 tREFI:14000) GPU: Asus GTX 1070 Dual (Super Jetstream vbios, +70(2025-2088MHz)/+400(8.8Gbps)) SSD: Samsung 840 Pro 256GB (main boot drive), Transcend SSD370 128GB PSU: Seasonic X-660 80+ Gold Case: Antec P110 Silent, 5 intakes 1 exhaust Monitor: AOC G2460PF 1080p 144Hz (150Hz max w/ DP, 121Hz max w/ HDMI) TN panel Keyboard: Logitech G610 Orion (Cherry MX Blue) with SteelSeries Apex M260 keycaps Mouse: BenQ Zowie FK1

 

Model: HP Omen 17 17-an110ca CPU: i7-8750H (0.125V core & cache, 50mV SA undervolt) GPU: GTX 1060 6GB Mobile (+80/+450, 1650MHz~1750MHz 0.78V~0.85V) RAM: 8+8GB DDR4-2400 18-17-17-39 2T Storage: 1TB HP EX920 PCIe x4 M.2 SSD + 1TB Seagate 7200RPM 2.5" HDD (ST1000LM049-2GH172), 128GB Toshiba PCIe x2 M.2 SSD (KBG30ZMV128G) gone cooking externally Monitor: 1080p 126Hz IPS G-sync

 

Desktop benching:

Cinebench R15 Single thread:168 Multi-thread: 833 

SuperPi (v1.5 from Techpowerup, PI value output) 16K: 0.100s 1M: 8.255s 32M: 7m 45.93s

Link to post
Share on other sites
4 minutes ago, Jurrunio said:

Z97 chipset only runs PCIe 2.0, if you write to a drive on that then you'll get a 2GB/s cap from there. Maybe something else is hogging transfer at the same time?

That being said, OP could try to run the network adapter in the single PCIe 3.0 x16 allocated, and either use integrated GPU or another PCIe x16 for graphics, to validate this theory.


Main: AMD Ryzen 7 1700X, Nvidia GTX 780, 16 GB 3200 MT/s DDR4

Secondary: Intel Xeon X5670, Nvidia GTX 660, 24 GB 1333 MT/s DDR3

Server: Intel Xeon X5670, 60 GB 1333 MT/s DDR3-R

Laptop: Intel Core i5-3320M, 16 GB 1600 MT/s DDR3

Link to post
Share on other sites
Posted · Original PosterOP
43 minutes ago, svmlegacy said:

That being said, OP could try to run the network adapter in the single PCIe 3.0 x16 allocated, and either use integrated GPU or another PCIe x16 for graphics, to validate this theory.

A good question, but both machines appear to be running from the PCIe 3.0 provision from the CPU rather than the chipset, and so are both running in PCIe 3.0 4x (3.8GB/s)

 

The NAS has no separate video card and is driven by the CPU.

 

NAS-Bus.thumb.png.78552400a713ad3c51626f731b2777c8.png

PC

 

PC-Bus.thumb.png.a5001bfbbaa9f639e57c85f74320bce7.png

NAS

Link to post
Share on other sites

I'm a bit confused regarding the storage configuration of the NAS.

Which filesystem is it running and how are the drives exactly configured? Is it a RAID array?

 

Also what exactly is it that you tried to transfer from your NAS to your PC?

Is it just a game-folder or is it something like a .zip? 

Link to post
Share on other sites
Posted · Original PosterOP
11 minutes ago, Senzelian said:

I'm a bit confused regarding the storage configuration of the NAS.

Which filesystem is it running and how are the drives exactly configured? Is it a RAID array?

 

Also what exactly is it that you tried to transfer from your NAS to your PC?

Is it just a game-folder or is it something like a .zip? 

NTFS and...

1 hour ago, WizPip said:

5x 1TB SSDs in a simple Storage Space with 5 columns

storage-space.thumb.PNG.5d8fbfda26d4a082a9d55c1cfc0e6435.PNG

Note that the space in question is called "Fast space". 5 columns means the data is striped across all 5 drives, so this is effectively RAID 0, which explains the 2113MB/s read and 2482MB/s write sequential shown above.

 

1588831643_storagespace.thumb.png.2c4a93b8a4a81656d474527c28dfa489.png

What the GUI shows (note that you can't configure columns in the GUI so if you're having issues with a simple space's speed, this is probably why)

 

I have tried with various types of files, the screenshot in the OP shows a single large mkv file being transferred. Trying multiple at the same time does not affect this overall speed, and yet there would be more overhead for the disks doing this (yet task manager shows nothing maxed), so I don't believe we're at the disk limits.

Link to post
Share on other sites
Posted · Original PosterOP

Just to confirm the speeds with only 1 cable I yanked one out during transfer, one from the PC and one from the NAS. It didn't stop transferring when I pulled one out but it got stuck for some time with one in each out. Then it took a few mins to start using both ports again when I replugged it all in.

 

I did confirm that the max speed with one cable in each is 1.08GB/s and the max I saw with two cables was 1.47GB/s. I guess I'm relatively happy with it overall, but if anyone at any time in the future notices an optimisation I've missed that can make it faster, let me know!

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now


×