File transfer questions Windows Server / NAS

[Doolali]

Howdy fellow nerds.

I'm looking for some advice on how to maximise the setup that I've got, or possibly make replacements.

I have 3 windows servers all with m.2 drives and 2.5Gb ethernet, connected together with a 2.5Gb switch. (WS2025)

I have a Mediator NAS which has 3 m2 drives in it as well.

The WS2025 are connected to the NAS via SMB as mapped Network drives.

 

I have a video encoding workflow that currently does:
- Download from S3 to NAS

- Copy from NAS to each server.

- Process Video

- Copy completed files onto NAS

- Upload to S3

 

The workflow is a little more complicated than that but that's the crux if it.

My main issue is that the transfer speeds are just SLOW, I'm moving from NAS to WS2025 at 10-20MBps.

CPU on the WS2025 is <5% for a transfer, the SSDs don't sweat. The NAS isn't complaining either, it as well has minimal usage.

 

I'm currently looking at a solution where I split the video into chunks so I can at least start processing the video whilst other files are still transferring but that's a fix for the wrong problem.

 

Any suggestions much appreciated!

[johnt]

Are all of the devices showing a network connection of 2.5 Gbps in the network settings?

 

Are you toying around with VLANs in anyway? This was my biggest problem. My controller switches at 1 Gbps over VLANs. I set my servers to the same VLAN and I had better luck.

 

What methods are you using to transfer files between servers? For some reason SMB seems to be unreliable for me. I have a lot of speed fluctuations even with large files. I've switched to FreeFileSync to transfer files using FileZilla for ftp, and now my hard drives are the bandwidth limitation, which is exactly where it should be.

[Doolali]

Mother clucker... OK, so the ONE server I was testing on was showing 100/100... the others are all 2500/2500 and were working fine... 

FACEPALM. Thanks though!

 

I'm guessing a driver issue...

[johnt]

2 minutes ago, Doolali said:

Mother clucker... OK, so the ONE server I was testing on was showing 100/100... the others are all 2500/2500 and were working fine... 

FACEPALM. Thanks though!

 

I'm guessing a driver issue...

That is easy money if that resolves your issue.