100TB Storinator Server

[nicklmg]

NCIX: http://bit.ly/1Pkeqlx

Amazon: http://geni.us/39uW

 

While preparing for the move to our new office we realized that our current storage solutions just wouldn't cut it... so we created something that will - the 100TB Storinator mass storage server!

 

https://www.youtube.com/watch?v=DfpzmAGjYqg&feature=youtu.be

[wolfgang]

oh my...

[pwn_intended]

sweet.

[AlexStriz]

Meanwhile, I just bought a new 500gb hard drive....

[Rune]

Good luck with the full sized 6 client test!

[AddonCustoms]

WOW!!! Give me a few years and I may need that. 

[imthewalrus]

I hope seagate knows that there is a really high chance that 20% of those drives will die within the first year. The other 80% should last a really long time though.

 

Edit: They are enterprise drives and I am dumb.

[79wjd]

Why is @LinusTech wearing a steel again 

[Deli]

Wow, awesome. When will Linus expand his network to one PB of storage??

[MrBucket101]

I hope seagate knows that there is a really high chance that 20% of those drives will die within the first year. The other 80% should last a really long time though

those are enterprise drives, not consumer ones

[Sam Z Man]

I only have a 300gb 5400rpm drive

[DIV1D3]

Not sure if video audio is off, or just my third damn mobo is fked...

 

I think there is actually a combination lol, at the end of the video the audio and video are out of sync. 

[nicklmg]

Not sure if video audio is off, or just my third damn mobo is fked...

 

I think there is actually a combination lol, at the end of the video the audio and video are out of sync. 

The majority of the video is fine for me, you're right about the end though Unfortunate...

[ofr057]

so many takes in this video?, I don't understand why you's didnt get smaller drive's as you had room in it to run more

[907rider]

sooooo much space!

 

Anyone else notice that they finally cranked up the saturation levels on the video? For a while the videos had been looking a tad washed out.

[Bicketybam]

All those un-sleeved power cables in there.  I understand that as a server device it is not going to be on display and to cut costs when being built the company that built it wouldn't do that, BUT this is a LMG system!  We have certain expectations! 

 

Where's the bling???

 

[CatCloud]

imagine this in 5-10 years but with SSD´s! 

mmmmmmmmmmm

 

100TB space with 1gb+ R/W 

mmmmmmmmmm

[JoaoPRSousa]

Noice. I have 1000 tho. GB

[Chronos5618]

But will it run Minecraft?

[VictorB]

Linus

 

You made mistake in your array building.

 

You made a 9 drive RaidZ2. But with RaidZ2 you need 6 10 14 drives for the best performance. So Multiplies of 4 drives + 2. Then you also can enable 4k sectors and that will perform better. Best Solution add 3 more drives and make 3x 10 drive RaidZ2.

 

And the molex spilters can cause problems because the molex connection isn't the best. So hope they use the highest quality molex splitters instead of cheap chinese splitters.

 

But it is a great build! Nice hardware platform. And I love the 3 SAS controllers.

 

Not sure about FreeNAS. I prefer Nas4Free or ZFSguru.

 

My own server is a 6x 3tb RaidZ2 with ZFSguru.

[DeViLzzz]

I got what I needed from the video in the first two and a half minutes.  Thanks for the simple explanation as to why this is all needed.  

[Nemo1911]

Hi and really good job!(First post here)

I would like to know your thoughts on this written by sub.messa (can't find original post):

"As i understand, the performance issues with 4K disks isn’t just partition alignment, but also an issue with RAID-Z’s variable stripe size.

RAID-Z basically works to spread the 128KiB recordsizie upon on its data disks. That would lead to a formula like:

128KiB / (nr_of_drives – parity_drives) = maximum (default) variable stripe size

Let’s do some examples:

3-disk RAID-Z = 128KiB / 2 = 64KiB = good

4-disk RAID-Z = 128KiB / 3 = ~43KiB = BAD!

5-disk RAID-Z = 128KiB / 4 = 32KiB = good

9-disk RAID-Z = 128KiB / 8 = 16KiB = good

4-disk RAID-Z2 = 128KiB / 2 = 64KiB = good

5-disk RAID-Z2 = 128KiB / 3 = ~43KiB = BAD!

6-disk RAID-Z2 = 128KiB / 4 = 32KiB = good

10-disk RAID-Z2 = 128KiB / 8 = 16KiB = good"

And is there any prefomance gains in spreading out the drives more evenly over the the controllers? as I've heard from some users using this system.

Did you do any sort of burn in test of the drives before use?

And lastly how frequently do you have scrubbing set up?

//Nemo

[Sharif]

Chicken on fishes,this is awesome 

[revox]

As previously said by others. The optimal configuration for a RAIDZ2 is either 4, 6, 10 or 18 drives.

These drives probably have 4k sector sizes so the pool should be aligned for 4k (ashift=12).

 

It might also be worth looking into compression. LZ4 is incredible and only compresses data with a minimal compression ratio of 12.5%.

[henrizzle]

But can it run Crysis?