slow writes

[mineblaster]

trying to build a backup server 

im using dual hex cores 2630L

64gb of ram

an lsi 9201e

and a mellanox 10gbe nic

 

i tryed unraid first where i would transfers would start at 350mb/s and slow down to 2mb/s across i have also installed windows server 2012r2 and made a pool with the 12 seagate es.2 drives

 

i updated the firmware on the controller but to no avail.

if anyone has ideas im open. ive been at it for 3 days now and it getting a little annoying

[unijab]

raid or jbod?

cpu and network usage during transfer?

[Jarsky]

When you updated the firmware, was that with the IT firmware?

If it was the IR firmware, have you checked the write mode e.g write-back / write-through. Also check that Fast Path isnt enabled. 

Have you also tried updating the Windows drivers?

[mineblaster]

6 hours ago, Jarsky said:

When you updated the firmware, was that with the IT firmware?

If it was the IR firmware, have you checked the write mode e.g write-back / write-through. Also check that Fast Path isnt enabled. 

Have you also tried updating the Windows drivers?

it was IT mode before version 17

i havent tryed new drivers as it picked it up when i installed windows 2012r2

as for the other features like fast path etc i dont think there supported ill look in the bios menu later for them

[mineblaster]

8 hours ago, unijab said:

raid or jbod?

cpu and network usage during transfer?

its a pool with storage spaces in server 2012r2 but it did the same behavior when i tryed unraid 6.3 and 6.5

[Mikensan]

Have you tested the speeds of each disk? Those are indeed some terrible write speeds.

 

Also your 4k Q32T1 reads seem pretty low too. I have a Raid 5 (RaidZ) that saturates my gigabit link for that test.

[scottyseng]

14 hours ago, mineblaster said:

-snip-

Yeah, those speeds are way too low. I wonder if something is preventing it from writing the full speed. I was going to say Windows Server, but you tried Unraid before. I know if you have Windows Server (The OS) on the same drive as the data array, it will cripple benchmarks. My OS SSD was the same way. Crystal Disk / benchmarking programs reported low write speeds, but if you actually wrote real data to it, it would go full speed. It was Windows Server limiting applications from hogging the main drive speed, but that wouldn't be the case for you.

 

Here's what I got in my RAID6 array (hardware RAID) of 8 4TB WD Re drives when it was new. It's dropped to 800MB/s now that the array is 70% full and has 11 drives. Also note that I test at 4GiB to avoid the RAID card buffering the test file on the RAID card's RAM: