LTT Storage Rankings

[IdeaStormer]

Update:

 

 

 

Nothing like a water main next to your server, living on the edge I see

[overflowsc]

Update:

 

Looks really cool (but yeah that pipe makes me panic a little too)

[PhantomWarz]

That looks really cool.

 

It seems to do the job Raboo. 

i just wanted something to provide redundancy.

Was using StableBit DrivePool before this setup, whcih worked flawlessly but does not offer any parity stripe on the data

[Gronnie]

I have edited my previous post, I added some new drives and hardware to bring the system up to 28TB (30TB if you include the two  1TB USB3 external drives connected to it full time.)

 

Edit 8/15/2014 - Total now 28TB (or 30 including 2 externals)

 

I have added another 4TB (6 if you include external drives). I picked up a CoolerMaster 4-in-3 adapter (STB-3T4-E3-GP) and an Icy Dock 3.5 to dual 2.5 mounting kit (MB290SP-B), as well as a 2 port SATA controller card (SYBA SY-PEX40039).

 

The drives are 2 WD 2TB green drives that I had laying around. Added them to the FlexRAID pool as a 4TB spanned DRU.

 

Also added a 1TB Toshiba USB3 drive for non-media files and whatnot, and a 1TB Matsunichi USB3 to use as a DVR and setup MB3's Live TV using ServerWMC.

 

The 4 in 3 adapter is really cool, and for the price the Icy Dock adapter is very nice and is very easy to use. The SATA controller card is good enough for my needs now as a media server, but I would like to eventually upgrade that to a nice 8 port IBM or LSI card.

 

 

[alpenwasser]

UPDATE

I did some work on the list. Each build now has its case

indicated on the list. To keep it correctly formatted on

smaller screens I have needed to introduce abbreviations,

a key is in the list post as well (shouldn't be too difficult

to understand I hope).

I have tested it on my own laptop, which has 1200x800

resolution and a vertical tabs browser extension (so I

don't have the full width of my screen available), and

it displays OK for me, so it should work on most reasonably

modern devices.

[jscho]

snip

 

Love the new formatting Probably one of the prettiest threads going :wub:

[alpenwasser]

- snip -

 

Ah, didn't even see your update.

Anyway, updated you to 28 TB (I don't think we count USB drives, sorry).

 

Love the new formatting Probably one of the prettiest threads going :wub:

Thank you, one does what one can. I must admit I am rather pleased with

it personally.

[alpenwasser]

Haha, double post!

Uhm, right, what I'm actually here to say is that I have

added some statistics to the ranking posts:

- arithmetic mean

- median

- grouped distribution

Thought I might as well make use of the fact that we're

using a script to do the list and do some minor data

processing. Besides, we make lists because we like stats,

dont we?

Tagging @looney for FYI.

[looney]

Haha, double post!

Uhm, right, what I'm actually here to say is that I have

added some statistics to the ranking posts:

- arithmetic mean

- median

- grouped distribution

Thought I might as well make use of the fact that we're

using a script to do the list and do some minor data

processing. Besides, we make lists because we like stats,

dont we?

Tagging @looney for FYI.

Awesome man! :D

 

Maybe also add the modus to make it complete?

[massiveturkey]

Added.

  

Added, welcome to the list!

You two wouldn't happen to be able to upload some pics of the

actual hardware. You know... for research purposes.

Oh, you naughty you. Asking to see a guys hardware like that!

[alpenwasser]

Awesome man!

 

Maybe also add the modus to make it complete?

 

You mean the RAID modus? Yeah, thought about that. Problem is,

then the lines get kinda long and the layout gets screwed up on

small-ish screens. I considered it, but in the end, if the

layout is to be more or less compatible with smaller screens,

I couldn't do both, so I decided to put in whether it's hardware

or software RAID and so on, as I thought that to be a bit more

suitable for a ranking list. I mean, whether or not somebody uses

RAID5, RAID6, RAID10 or w/e is more of an implementational detail

(to me at least), whereas the question of whether or not they're

using hardware or software RAID (or JBOD, or SHR, or w/e) is a bit

more general and hence a bit more suitable for a summary of the

specs (which the list kinda is in the end) I think?

EDIT:

Also, since some members are mixing RAID modi, lines get even

longer when you list all of those.

/EDIT

 

Oh, you naughty you. Asking to see a guys hardware like that!

Well, that's what we're here for, isn't it?

[looney]

 

You mean the RAID modus? Yeah, thought about that. Problem is,

then the lines get kinda long and the layout gets screwed up on

small-ish screens. I considered it, but in the end, if the

layout is to be more or less compatible with smaller screens,

I couldn't do both, so I decided to put in whether it's hardware

or software RAID and so on, as I thought that to be a bit more

suitable for a ranking list. I mean, whether or not somebody uses

RAID5, RAID6, RAID10 or w/e is more of an implementational detail

(to me at least), whereas the question of whether or not they're

using hardware or software RAID (or JBOD, or SHR, or w/e) is a bit

more general and hence a bit more suitable for a summary of the

specs (which the list kinda is in the end) I think?

EDIT:

Also, since some members are mixing RAID modi, lines get even

longer when you list all of those.

/EDIT

 

Well, that's what we're here for, isn't it?

o0 crap translation error, modus=mode, as in average, median, mode. 

so the most common capacity in the list

[alpenwasser]

o0 crap translation error, modus=mode, as in average, median, mode. 

so the most common capacity in the list

Ah, lol, yeah, facepalm.

Good idea actually, yes, will get on that.

EDIT: TADA!

Edited August 18, 2014 by alpenwasser

[alpenwasser]

Okidoki, I was curious about HDD statistics, and TADA!

 

Since almost everybody has indicated at least the vendor and specific size of their

drives, I was able to put this together (yes, I had some free time...).

 

@looney, @Whaler_99, @MG2R: FYI.

 

Of course, it can also be found in the actual rankings post, but I thought I'd put

it here as well for those too lazy to click that button.

 

EDIT 2: OK, should be fixed now.

EDIT 3: Added average drives per system.

 

Statistics

---

System Statistics
Arithmetic Mean Capacity                    27.5 TB
Median Capacity                             21.0 TB
Mode (most common capacity)                 15.0 TB (number of occurrences: 6)
Number of Unique Capacities                 29

Grouped Distribution
10 TB ≤ capacity < 20 TB     25 systems
20 TB ≤ capacity < 30 TB     18 systems
30 TB ≤ capacity < 40 TB      2 systems
40 TB ≤ capacity < 50 TB      4 systems
50 TB ≤ capacity < 60 TB      1 systems
60 TB ≤ capacity < 70 TB      3 systems
70 TB ≤ capacity < 80 TB      1 systems
80 TB ≤ capacity < 90 TB      2 systems

HDD Statistics
Total Number of Drives                 616
Average Drives per System               11
Total Combined Capacity          1539.5 TB
Average Drive Capacity              2.5 TB
Median Drive Capacity               2.0 TB

HDD Statistics, by Size
Vendor                 Count           Sum        Percentage of Total
0.50 TB             8 drives        4.0 TB                      0.26%
0.75 TB             2 drives        1.5 TB                      0.10%
1.00 TB            43 drives       43.0 TB                      2.79%
1.50 TB            26 drives       39.0 TB                      2.53%
2.00 TB           262 drives      524.0 TB                     34.04%
3.00 TB           172 drives      516.0 TB                     33.52%
4.00 TB           103 drives      412.0 TB                     26.76%
TOTAL             616 drives     1539.5 TB

HDD Statistics, by Vendor
Vendor                 Count           Sum     Percentage of Total
                                               Drive Count       Capacity
WD                292 drives      721.5 TB          47.40%         46.87%
Seagate           183 drives      508.0 TB          29.71%         33.00%
unspecified        52 drives      101.5 TB           8.44%          6.59%
HGST               43 drives      115.0 TB           6.98%          7.47%
Samsung            35 drives       60.5 TB           5.68%          3.93%
Toshiba            11 drives       33.0 TB           1.79%          2.14%
TOTAL             616 drives     1539.5 TB

Edited August 18, 2014 by alpenwasser
average drives per system

[d33g33]

lol, nice.

[alpenwasser]

lol, nice.

Thanks, I wonder how long it will take us to get to 1000 HDDs.

Also: @looney: @Whaler_99 is ahead of you again.

[Whaler_99]

I need to update my post as well with the latest info

[d33g33]

Thanks, I wonder how long it will take us to get to 1000 HDDs.

Also: @looney: @Whaler_99 is ahead of you again.

I'm happy to see you back.

[alpenwasser]

I'm happy to see you back.

Thanks, not fully yet though. Have needed to postpone surgery,

surgeons are very busy. I'm not at 100%, but one needs to do

something to pass the time. So still somewhat reduced presence,

but doing what I can at the moment.

[Shaqalac]

Thanks, I wonder how long it will take us to get to 1000 HDDs.

I guess I should stop lurking, submit my storage server and contribute a little to the list and the statistics. 

[alpenwasser]

I guess I should stop lurking, submit my storage server and contribute a little to the list and the statistics. 

Yes you should!

[Blade of Grass]

*build log available here*

 

Hardware

CASE: Corsair C70

PSU: XFX 850w ProSeries

MB: MSI Z77 GD-65

CPU: Intel 3570k

HS: Cooler Master Hyper 212 Plus

RAM: Corsair 8GB 1600MHz LP

SSD: Crucial M500 120GB

HDD 0-1: 3TB Seagate NAS drives

HDD 2: 1TB WD Blue

Software and Configuration:

This server is running Debian, and currently has a mirrored ZFS array (making 3TB of storage).

I’m planning to add up to 6x 3TB drives in the future and make a RAIDZ2 array.

Usage:

This computer is going to be used to server media to devices around my house, along with file sharing for me when I’m on the go/across devices. It will also be used to back up my computers/documents, and my large RAW photo library.

Backup:

None at this moment due to internet caps.

Additional info:

This was my old rig which I repurposed into a server, hence why the kind of strange mix of components.

Photo's:

 

Outside

 

Internal:

 

Harddrives

Networked storage

[Raboo]

Hardware

CASE: Corsair C70

PSU: XFX 850w ProSeries

MB: MSI Z77 GD-65

CPU: Intel 3570k

HS: Cooler Master Hyper 212 Plus

RAM: Corsair 8GB 1600MHz LP

SSD: Crucial M500 120GB

HDD 0-1: 3TB Seagate NAS drives

HDD 2: 1TB WD Blue

That's a very nice looking server.

[Blade of Grass]

That's a very nice looking server.

Why, thank you!

I believe my server and your rig are siblings.

[alpenwasser]

- snip -

Wohoo, nice box indeed.

Also, @looney: The script rewrite is complete, it fixes some formatting

stuff, but for now the end result should be mostly the same as the old

script, but with much more code!

It is however rather cleaner and should be more easily expandable than

the old codebase for adding more functionality in the future.

 

 

EDIT: The Current statistics:

Statistics

---

Systems Summary

Arithmetic Mean Capacity           27.6 TB

Median Capacity                    21.0 TB

Mode (most common capacity)        15.0 TB (number of occurrences: 6)

Number of Unique Capacities             29

Grouped Distribution

10 TB ≤ capacity < 20 TB                25

20 TB ≤ capacity < 30 TB                18

30 TB ≤ capacity < 40 TB                 2

40 TB ≤ capacity < 50 TB                 4

50 TB ≤ capacity < 60 TB                 1

60 TB ≤ capacity < 70 TB                 3

70 TB ≤ capacity < 80 TB                 1

80 TB ≤ capacity < 90 TB                 2

HDD Statistics

Total Number of Drives                 629

Average Drives per System             11.2

Total Combined Capacity          1544.1 TB

Average Drive Capacity              2.5 TB

Median Drive Capacity               2.0 TB

HDD Statistics, by Size

Capacity              Count              Sum       Percentage of Total

                                                    Count     Capacity

0.50 TB           17 drives           8.5 TB        2.70%        0.55%

0.64 TB            1 drives           0.6 TB        0.16%        0.04%

0.75 TB            2 drives           1.5 TB        0.32%        0.10%

1.00 TB           50 drives          50.0 TB        7.95%        3.24%

1.50 TB           27 drives          40.5 TB        4.29%        2.62%

2.00 TB          256 drives         512.0 TB       40.70%       33.16%

3.00 TB          173 drives         519.0 TB       27.50%       33.61%

4.00 TB          103 drives         412.0 TB       16.38%       26.68%

TOTAL            629 drives        1544.1 TB

HDD Statistics, by Vendor

Vendor                Count              Sum       Percentage of Total

                                                    Count     Capacity

WD               313 drives         756.6 TB       49.76%       49.00%

Seagate          194 drives         517.0 TB       30.84%       33.48%

HGST              43 drives         115.0 TB        6.84%        7.45%

Samsung           36 drives          61.0 TB        5.72%        3.95%

unspecified       32 drives          61.5 TB        5.09%        3.98%

Toshiba           11 drives          33.0 TB        1.75%        2.14%

TOTAL            629 drives        1544.1 TB

Edited August 23, 2014 by alpenwasser
stats