LTT Storage Rankings

[alpenwasser]

- snip -

Nice, added you to list.

Bonus points for starting your HDD numbering at index 0.

[Gronnie]

Nice, added you to list.

Bonus points for starting your HDD numbering at index 0.

I am a computer nerd, is there any other way?

[alpenwasser]

I am a computer nerd, is there any other way?

No, no there is not. For some reason some weirdos seem to insist

that there is, but they are wrong.

[MG2R]

Bonus points for starting your HDD numbering at index 0.

Am I blind, or is my monitor broken? For me, the HDDs say: PD[1-2], DD[1-4]

[alpenwasser]

Am I blind, or is my monitor broken? For me, the HDDs say: PD[1-2], DD[1-4]

 

This is what I was refering to:

 

HDD 0: Seagate ST4000DM000

HDD 1: Seagate ST4000DM000

HDD 2: Seagate ST4000DM000

HDD 3: Seagate ST4000DM000

HDD 4: Seagate ST4000DM000

HDD 5: Seagate ST4000DM000

[Gronnie]

Am I blind, or is my monitor broken? For me, the HDDs say: PD[1-2], DD[1-4]

 

Good catch, I have no idea why I started at one on those.... :unsure:

[alpenwasser]

Good catch, I have no idea why I started at one on those.... :unsure:

We will attribute it to temporary lapse of judgement and

never speak of it again.

[PBaines]

It's not quite 10TB yet, I need another SAS cable and 3 more 3TB Reds to put in here. Server currently has 4 x 3TB Red Drives in RAID 5 so lose one drive. Also 10% reservation to prevent overflow with ZFS

 

[RandomNOOB]

4x3TB = 12TB, you're in mate!

[alpenwasser]

It's not quite 10TB yet, I need another SAS cable and 3 more 3TB Reds to put in here. Server currently has 4 x 3TB Red Drives in RAID 5 so lose one drive. Also 10% reservation to prevent overflow with ZFS

 

 

4x3TB = 12TB, you're in mate!

Indeed!

We don't subtract storage used for RAID redundancy, just the raw

disk space. So by our rules you do indeed have 4 × 3 TB = 12 TB.

All you need to do now is plug your machine into looney's template

from this post and we'll put you onto the list.

Don't forget some hardware pics of the server.

[IdeaStormer]

So if I buy two 6TB drives I'll be in, buahahahahah

[jscho]

So if I buy two 6TB drives I'll be in, buahahahahah

I suppose so!

[alpenwasser]

So if I buy two 6TB drives I'll be in, buahahahahah

 

 

I suppose so!

As long as it's in a dedicated storage machine, with current rules, yes.

@looney could just change the rules though, add a minimum number of drives

criterion.

[2sysel2]

well I'm almost there, one more drive and I'll join the club (probably after next payday)
http://linustechtips.com/main/topic/164936-asgard-data-server-pentium-g3420z87-irm450prodigy/

---

EDIT: inserted post here - alpenwasser
 

Name :

Well I use mythical name for all my computers and Realm Eternal that's where i would like my data.

 

Usage :

This machine will serve as NAS, Plex server, Teamspeak server and i might host few games for me and my friends.

 

Specs:

CPU : Intel Pentium G3420

MB : Asus Z87i-pro (i know it's overkill but it was taken from my other pc when i got new MB)

RAM : Corsair Vengence Black 8gb CL10

PSU : Corsair RM450

Case : Bitfenix Prodigy White mITX

Storage :

Kingston SSDNow V300 60GB (System drive)

Intel SSD 520 120GB (Most of the servers)

WD RED 3TBx3 (Storage space)

 

Storage configuration:

For now the storage will be set up as JBOD. I might go with RAID1 when i get 2 more drives for backing up photos and other stuff from the network. The other REDs will stay JBOD or I might change them to RAID1 I'm not really sure right now.

 

Backup:

Well this is going to be backup for the rest of the computers. I don't have any plans for backing up this machine expect syncing my photos to Dropbox.

 

Photos:

I'll attach few photos of the system.

 

My thoughts about this build:
Well for now it is working fine. My only problem was with the build quality of the Prodigy drive cage - my other build is in Fractal Design Define XL R2 and the drive cages there are much better. The temperatures of the drives are usually lower but this week is really toasty where i live(room temperature around 30 degeres C)

This build might be WIP for a long time. I'm thinking about adding optical drive so I potentialy could make images of instalation drives for laptops(I only have 1 optical drive now and it is really unreliable - it's taken from my Asus N53SN and it's i usb bos).

 

 

Edited July 11, 2014 by 2sysel2

[unknownkwita]

It is worth discussing, that inevitably at some point the 10TB Hurdle will need to be increased, otherwise the list will be pointless once 16TB drives are common. Im not suggesting this happen now, but it is enevitably.

[jscho]

As long as it's in a dedicated storage machine, with current rules, yes.

@looney could just change the rules though, add a minimum number of drives

criterion.

 

Or start only counting 'usable' storage

 

[alpenwasser]

It is worth discussing, that inevitably at some point the 10TB Hurdle will need to be increased, otherwise the list will be pointless once 16TB drives are common. Im not suggesting this happen now, but it is enevitably.

 

Yeah, it likely won't stay at 10 TB forever. I could also see

adding a criterion for minimum number of drives.

 

Or start only counting 'usable' storage

Probably not, things can get annoyingly complicated if you take

that into account, plus it's more about showing off your hardware.

[jscho]

Probably not, things can get annoyingly complicated if you take

that into account, plus it's more about showing off your hardware.

 

It was a joke suggestion But yes, taking 'usable' storage would be rather inconvenient

[Alexdaman]

Drobos are fine by me, always nice to see more options for people to look at when they are building a storage setup.

 

I heard some horror-stories about the Drobo.... 

I nearly purchased one of the early one's , I am glad I went with a server . 

[alpenwasser]

well I'm almost there, one more drive and I'll join the club (probably after next payday)

http://linustechtips.com/main/topic/164936-asgard-data-server-pentium-g3420z87-irm450prodigy/

Apologies, forgot to respond to your post. There's no need to make

a separate thread for your build (of course you're allowed to do

that, no problem), we just have them right in this thread. I have

therefore edited your post accordingly with the information from

your thread in the build log section. For now your system will

reside on the secondary list, just let us know when you upgrade

your storage and it will be automatically bumped to the primary

rankings.

[overflowsc]

Hardware
CASE: Fractal Design Node 804 (SKU: 97165)
PSU: Be Quiet! Pure Power L8 600W (SKU: 90532)

UPS: Cyberpower CP1000AVRLCD 1000VA 600W (SKU: 36273)
MB: ASUS H97M-PLUS LGA1150 (SKU: 97033)
CPU: Intel Core i5 4570 @ 3.2GHz (SKU: 81329)
HS: Some Cooler Master 92mm I had (Don't remember the model)
RAM: ADATA Xpg V1.0 16GB DDR3-1600 CL9-9-9-24 (2x8GB) (SKU: 93608)
SATA / RAID CARD: Syba SY-PEX40008 (SKU: 53815)
SSD: Samsung 840 Evo 120GB (SKU: 87760)
HDD 1: 5x 4TB Seagate ST4000VN000 (SKU: 85198)
HDD 2: 1x 2TB Samsung HD204UI (From old external HDD)
HDD 3: 1x 2TB Western Digital WD20EZRX-00D8PB0
HDD 4: 1x 500GB Samsung HD502IJ (From old external HDD)

Software and Configuration:
My server is running Linux Mint 16 (non-server version). I am using sofware raid with mdadm. The 5 4TB disks are in RAID6 and the others are in JBOD.

So before anyone say anything!! I know that this build is really...really overkill for a NAS. The reason behind this is that I don't have much room and that I will use this system to host some VMs as well. The JBOD drives will mostly be for backup and archive. It may also serve as Steam In-Home Streaming client for my TV.

 

Total space: 24.5TB 

Actual Space: 16,5TB

 

Usage:
Storage...Basically everything I have is in there.

Media PC

Steam In-Home Streaming client

Hosting VMs

All my roommates are using it to backup series and movies

Backup:
I have an external 1TB HDD on an external site for really important files

The backups are made manually atm to the JBOD drives from the RAID array

Additional info:
Haswell = No power!!

Fractal Design Node 804 = WIN

I didn't need the RAID functionnality on the PCI-e card because I only use it for backup drives so I didn't mind getting a cheap card

600W was really overkill...even if I add a GPU...

I added a 120mm fan on the HDD + PSU side just to be sure

 

Photos:

 

From the NAS (The 640GB one is an external USB hard drive not included in the specs)

 

From my PC

 

The space between the hard drives on the right and the PSU was really tight considering I did not have 90 degres connectors on the SATA cables.

 

Death from above

 

TIGHT TIGHT TIGHT (and poor cable management)

 

The SSD is in the front panel and there is still room for one more

 

There are still 2 x 3.5" support at the bottom for HDDs

 

Cheers

 

 

Final result

 

Final result #2

 

Final result #3

[electrostatic]

Hey all, just saw this thread and thought I'd show off the FreeNAS monstrosity I've been cobbling together over the last 8 months or so.  It started as two old drives and a usb thumb drive in a Windows 7 box and steadily grew into what it is now.
 
Name: ATLAS
 
Usage:

• Central backup for desktops (two Macs and 3 Win 8.1.1 PCs)
• Shared working volume for all machines (ie. when renderfarming Blender animations)
• Software installer repository (ISOs, installers, utils, etc.)
• Media storage and serving (Plex plug-in / generic DLNA)
• Consolidate storage in general: death to external HDs.
• Learning to become one with the ways of ZFS

 

Current Specs:
 
CPU: AMD FX4350 4.2GHz (turbo core off, all other settings default)
RAM: Four 8GB G.Skill Ripjaws Series X 1866 kits (left to default 1333)
MOBO: ASUS M5A99X R2.0 (95% default settings with all extra onboard features turned off)
NIC: Intel Gigabit CT PCIe x1
PSU: Seasonic 550RM 80+ gold
CASE: Cooler Master HAF 912 (with Cooler master 4 in 3 drive module)
Cooling: Noctua NH-U14S with second 15cm fan, two 120mm Corsair AF Quiet in front, one Noctua P12-1300 top front, Noctua S12PWM rear case and Noctua NF-A14PWM side door
Video: some old NVIDIA PCI card (to save on PCIe space)
SATA HBAs: 3 x Highpoint Rocket 640L (4xSATA III ports, PCIe2.0 x4)
 
 

Storage Devices:

 

4 x WD Red 1TB
2 x WD Red 2TB
2 x WD Red 3TB
2 x WD Green 2TB
1 x WD Green 3TB
 

(Total raw server storage = 21TB)
 

OS, cache and other devices
ADATA 8GB USB thumb drive (FreeNAS (FreeBSD) OS boot)

Corsair Accelerator 60GB SSD

OCZ Synapse Caching SSD (60GB, firmware over-provisioned to 30GB)

 

Storage Configuration
 
I have three ZFS pools configured like this:
 
zpool iostat -v
 
                                           capacity     operations    bandwidth
pool                                    alloc   free   read  write   read  write
--------------------------------------  -----  -----  -----  -----  -----  -----
redpool                                 2.43T  3.91T      0      0      0      0
  mirror                                 691G  2.04T      0      0      0      0
    gptid/3b7ce70f-e2de-11e3-5ca0e7d2d      -      -      0      0      0      0
    gptid/3c49195b-e2de-11e3-5ca0e7d2d      -      -      0      0      0      0
  mirror                                 670G  1.16T      0      0      0      0
    gptid/3d134d94-e2de-11e3-5ca0e7d2d      -      -      0      0      0      0
    gptid/3ddcde6c-e2de-11e3-5ca0e7d2d      -      -      0      0      0      0
  mirror                                 561G   367G      0      0      0      0
    gptid/3e8ef650-e2de-11e3-5ca0e7d2d      -      -      0      0      0      0
    gptid/3f499825-e2de-11e3-5ca0e7d2d      -      -      0      0      0      0
  mirror                                 569G   359G      0      0      0      0
    gptid/4009c45b-e2de-11e3-5ca0e7d2d      -      -      0      0      0      0
    gptid/40d0638f-e2de-11e3-5ca0e7d2d      -      -      0      0      0      0
logs                                        -      -      -      -      -      -
  gpt/zil                                260K  1.98G      0      0      0      0
--------------------------------------  -----  -----  -----  -----  -----  -----
stripe_pool                             3.34T  3.00T      0      0      0      0
  gptid/9ea33c3b-da38-11e3-805ca0e7d2d  1.27T  1.45T      0      0      0      0
  gptid/9f365f41-da38-11e3-805ca0e7d2d  1.03T   799G      0      0      0      0
  gptid/9ffcae67-da38-11e3-805ca0e7d2d  1.04T   787G      0      0      0      0
--------------------------------------  -----  -----  -----  -----  -----  -----
system_ssd                              22.6G  30.9G      0      0      0      0
  gptid/c79241d9-91b8-11e3-805ca0e7d2d  22.6G  30.9G      0      0      0      0
--------------------------------------  -----  -----  -----  -----  -----  -----
 
 
'redpool' is a ZFS dynamic stripe of mirrors (RAID10, ZFS style) using all the WD Reds in size-matched pairs and is where all my media and daily datasets (ZFS-speak for 'volumes') live

'stripe_pool' is a ZFS dynamic RAID 0 that holds a local rsync mirror of the contents of redpool and datasets for my desktop machines' hourly incrementals Win8 file history and Mac OS X Timemachine.  This stripe is a nice example of ZFS's dynamic striping at work:  It's made of one 3TB SATA III HD and two 2TB SATA II drives.  Traditionally, that would normally be a terrible idea for a stripe, but in my experience here it's been an amazing demonstration of ZFS's dynamic striping at work: when the pool/stripe was created, I could see ZFS measure the size and performance of each member disk.  Then as I dumped a few TB of data on it I could watch as the IO operations and data payloads were assigned to each disk based on its capabilities.  Sooo, the pool's performance isn't capped by its slowest member device!  Pretty awesome stuff.  (RAID0 caveats and warnings still apply of course.)

 

'system_ssd' is FreeNAS' system log store, my home directory and where the plugin jail datasets are. (the old Corsair SSD)

 

A little 2GB partition on the OCZ synapse SSD houses the ZFS intent log store for redpool
 
Pictures
 

Forgive the complete lack of cable management, I am rebalancing the mirrored pairs across the controllers so that no two halves of a mirror vdev are on the same controller.
 

 
 
Stack of Drives
 
 

 

 

 

Thoughts

 

This is by no means finished, I just ordered an IBM Serveraid M1015, so the controller/cable mess will be cleaned up soon.

 

Might not be the 'proper' way to set up a FreeNAS system, but as it is, the system is wicked fast and so far rock solid.

 

Questions and nice comments are welcome!

 

 

Edited to clarify some details and properly categorize storage device usage.  

[overflowsc]

 

Questions and nice comments are welcome!

 

That's a lot of drives in that case.

 

Nice build but how the hell are you getting these SSDs out?

[Raboo]

Hardware

SATA / RAID CARD: Syba SY-PEX40008 (SKU: 53815)

SSD: Samsung 840 Evo 120GB (SKU: 87760)

HDD 1: 5x 4TB Seagate ST4000VN000 (SKU: 85198)

HDD 2: 1x 2TB Samsung HD204UI (From old external HDD)

HDD 3: 1x 2TB Western Digital WD20EZRX-00D8PB0

HDD 4: 1x 500GB Samsung HD502IJ (From old external HDD)

That case is very full

[Raboo]

Questions and nice comments are welcome!

Can you fit any more drives in that case?