LTT Storage Rankings

[Brian Furious]

15 hours ago, 8uhbbhu8 said:

UPDATE!! WOO!!!!

 

Server1:

Dell R710

2x Xeon x5650

40GB DDR3 ECC Ram

Windows Server 2012 R2

1 (for now) dell 870w psu

Perc 6i

Perc H800

3x Corsair 500GB SSDS

1 250GB 7200RPM HDD

3x 146GB 10k RPM Dell HDDs

 

Dell MD 1200 SAS Expansion Array

8 WD 3TB 7200RPM HDDs

 

Total Space Available:

Server: 2188 GB

MD1200: 24TB

 

Usable Space:

Server: 1626GB

MD1200: 16.3TB

What's the power consumption of your server?

[8uhbbhu8]

29 minutes ago, Brian Furious said:

What's the power consumption of your server?

Right now it's saying 152w but that'

s not including the MD1200 so probably ~200w

[MediaMan]

I know Externals do not count, but I prefer them tbh.  Never had a single problem with any of my externals, whereas ive had some problems with Internals.  All in all, while I don't expect to be counted, am at 231TB.

[dalekphalm]

3 hours ago, 8uhbbhu8 said:

Right now it's saying 152w but that'

s not including the MD1200 so probably ~200w

I too have an MD1200 - love it (currently has 6x 3TB and 2x 4TB inside) - but holy crap, it's loud A.F.

 

I've been considering buying a really long SAS SFF-8088 cable and sticking the thing in another room. But I've heard the longest you can find the cables in is around 3m or so.

[RobbinM]

If they're as loud as MD1000's are, then yup those are loud. With SATA drives you can consider modding the fans, SAS drives run a little hotter.

I would not have considered them if I wasn't planning to put the whole rack behind a door.

 

I see @ololax, @GDRRiley, @8uhbbhu8 updates also running enterprise stuff. I see you're men of culture as well

@Charles_2007 pushing his pavilion to the limits, @LIGISTX running a really beefy Corsair case, that thing must be huge! Your virtualized FreeNAS certainly is interesting.

 

So are you guys planning on getting 10Gb/s ethernet? I'm getting tired of seeing my 1Gb/s connection maxed out all the time...

For me, only the link between the 'blu-ray ripping  ' machine and the FreeNAS is an irritating bottleneck. Being in the same rack, a 10Gb/s card and a DAC cable seems to be an economical solution.

My source for cheap 4TB SAS drives (€25) has dried up for the moment until they refresh a new batch, so I'm looking for some other upgrades in the meanwhile.

If I get really bored I might end up doing the whole layout for the rack differently. Doing it a little more the FibreNinja way this time, less Spiderman style.

[LIGISTX]

1 minute ago, RobbinM said:

If they're as loud as MD1000's are, then yup those are loud. With SATA drives you can consider modding the fans, SAS drives run a little hotter.

I would not have considered them if I wasn't planning to put the whole rack behind a door.

 

I see @ololax, @GDRRiley, @8uhbbhu8 updates also running enterprise stuff. I see you're men of culture as well

@Charles_2007 pushing his pavilion to the limits, @LIGISTX running a really beefy Corsair case, that thing must be huge! Your virtualized FreeNAS certainly is interesting.

 

So are you guys planning on getting 10Gb/s ethernet? I'm getting tired of seeing my 1Gb/s connection maxed out all the time...

For me, only the link between the 'blu-ray ripping  ' machine and the FreeNAS is an irritating bottleneck. Being in the same rack, a 10Gb/s card and a DAC cable seems to be an economical solution.

My source for cheap 4TB SAS drives (€25) has dried up for the moment until they refresh a new batch, so I'm looking for some other upgrades in the meanwhile.

If I get really bored I might end up doing the whole layout for the rack differently. Doing it a little more the FibreNinja way this time, less Spiderman style.

no 10GBE anytime soon for me, just no need... Maybe in a few more years as a "why not".

 

And yea, virtualized under ESXi is pretty wonderful. Its VERY nice to have separated the file handler which is freenas from any automation and applications which are handled by various flavors of linux with virtual nics connecting them which results in "totally fine" performance for my needs.

[GDRRiley]

32 minutes ago, RobbinM said:

If they're as loud as MD1000's are, then yup those are loud. With SATA drives you can consider modding the fans, SAS drives run a little hotter.

I would not have considered them if I wasn't planning to put the whole rack behind a door.

 

I see @ololax, @GDRRiley, @8uhbbhu8 updates also running enterprise stuff. I see you're men of culture as well

@Charles_2007 pushing his pavilion to the limits, @LIGISTX running a really beefy Corsair case, that thing must be huge! Your virtualized FreeNAS certainly is interesting.

 

So are you guys planning on getting 10Gb/s ethernet? I'm getting tired of seeing my 1Gb/s connection maxed out all the time...

For me, only the link between the 'blu-ray ripping  ' machine and the FreeNAS is an irritating bottleneck. Being in the same rack, a 10Gb/s card and a DAC cable seems to be an economical solution.

My source for cheap 4TB SAS drives (€25) has dried up for the moment until they refresh a new batch, so I'm looking for some other upgrades in the meanwhile.

If I get really bored I might end up doing the whole layout for the rack differently. Doing it a little more the FibreNinja way this time, less Spiderman style.

I can't really,  my servers are in a back room that a ways away and outside so I'd need waterproof cat 6A. 

I just need more drives and to actually have the DL380 work.

[ololax]

11 hours ago, RobbinM said:

If they're as loud as MD1000's are, then yup those are loud. With SATA drives you can consider modding the fans, SAS drives run a little hotter.

I would not have considered them if I wasn't planning to put the whole rack behind a door.

 

I see @ololax, @GDRRiley, @8uhbbhu8 updates also running enterprise stuff. I see you're men of culture as well

@Charles_2007 pushing his pavilion to the limits, @LIGISTX running a really beefy Corsair case, that thing must be huge! Your virtualized FreeNAS certainly is interesting.

 

 So are you guys planning on getting 10Gb/s ethernet? I'm getting tired of seeing my 1Gb/s connection maxed out all the time...

For me, only the link between the 'blu-ray ripping  ' machine and the FreeNAS is an irritating bottleneck. Being in the same rack, a 10Gb/s card and a DAC cable seems to be an economical solution.

My source for cheap 4TB SAS drives (€25) has dried up for the moment until they refresh a new batch, so I'm looking for some other upgrades in the meanwhile.

If I get really bored I might end up doing the whole layout for the rack differently. Doing it a little more the FibreNinja way this time, less Spiderman style.

Ehrm, I'm already running it on a SFP+ 10gbit connection, to the internet

[Jonny]

40 minutes ago, ololax said:

Ehrm, I'm already running it on a SFP+ 10gbit connection, to the internet

How much you paying for that 10gbit connection?

[ololax]

23 hours ago, Jonny said:

How much you paying for that 10gbit connection?

I'm not paying for it, I get it from work, #ISPstuff.

Otherwise a 1gbit/1gbit connection is 79€ and a 10gbit/10gbit is 490€ list price

[Jonny]

12 minutes ago, ololax said:

I'm not paying for it, I get it from work, #ISPstuff.

Otherwise a 1gbit/1gbit connection is 79€ and a 10gbit/10gbit is 490€ list price

Lucky you, I only get about 50/9, don't always get that sometimes. although I only pay £28, but can't get anything faster.

Wish the UK rolled out G.Fast VDSL faster, then I could get even better speeds or FTTP that would be bliss

[ololax]

The ISP I work for do ftth only, worst performance we have is ethernet from basement to apartment. 100/10 for 30€ unmetered as our most common contract. But yeah, fttp is a good first step, vdsl I'm not too impressed by, can't handle distances well enough.

[Jonny]

2 minutes ago, ololax said:

The ISP I work for do ftth only, worst performance we have is ethernet from basement to apartment. 100/10 for 30€ unmetered as our most common contract. But yeah, fttp is a good first step, vdsl I'm not too impressed by, can't handle distances well enough.

VDSL is annoying as its half duplex as I think, so that's annoying.

One day I'll hopefully get FTTP, can't keep using the old phone lines for ever surely.

[RobbinM]

On 1/18/2019 at 8:00 AM, GDRRiley said:

I can't really,  my servers are in a back room that a ways away and outside so I'd need waterproof cat 6A. 

I just need more drives and to actually have the DL380 work.

So what's wrong with that HP DL380, I might be of some help.

[GDRRiley]

9 hours ago, RobbinM said:

So what's wrong with that HP DL380, I might be of some help.

I can't get any OS to install and now I believe the DVD drive broke fun  

[Jonny]

21 minutes ago, GDRRiley said:

I can't get any OS to install and now I believe the DVD drive broke fun  

Do you get any errors trying to install an OS? Also what OS?

 

Boot from USB?

[GDRRiley]

Just now, Jonny said:

Do you get any errors trying to install an OS? Also what OS?

 

Boot from USB?

I'll make a new topic to not derail this one.

[Jonny]

1 minute ago, GDRRiley said:

I'll make a new topic to not derail this one.

Good idea.

Do link

[Dr_Frankenstein]

This is an update on my previous two posts

412+

1815+

 

 

Hardware

Synology 1815+ and Synology DX413 Expansion Unit

HDD 1: 4TB Seagate ST4000DM000

HDD 2: 4TB Seagate ST4000DX000

HDD 3: 4TB Western Digital WD40EZRZ

HDD 4: 4TB Seagate ST4000DX000

HDD 5: 4TB Seagate ST4000DM000

HDD 6: 4TB Seagate ST4000DM000

HDD 7: 4TB Western Digital WD40EZRX

HDD 8: 4TB Seagate ST4000DM000

HDD 9: 256GB Drevo X1 Pro

HDD 10: 3TB Western Digital WD30PURX

HDD 11: 3TB Western Digital WD30PURX

HDD 12: 3TB Toshiba DT01ABA300

HDD 13: 2TB Seagate ST2000VX000

 

Software and Configuration:

Running Synology DSM front end GUI, the 8 x 4TB drives in the main unit are running SHR2 (equivalent to RAID6 so that's 32TB (29.12TB RAW/21.81TB after redundancy) the other 4 drives are running SHR (RAID5) 11TB (10.01TB RAW/7.26TB after redundancy) finally the SSD contains all my Docker containers and any native Synology apps the SSD works really well for this usage and is much quicker than using it as an SSD read cache which I found had a negative performance impact on the unit.

Usage:

I upgraded from my 412+ around a year ago picking up an 1815+ for around £600 on eBay, about 6 months ago it was warranty replaced due to suffering from the Intel C2000 bug. It runs 24/7 and has been upgraded with 16GB of Crucial RAM, I use it as my main storage server, I make very good use of Docker as all my most useful applications for obtaining Linux ISO's are Dockerised (see my website for guides) It also runs a Minecraft server which is open for anyone to use.

 

I rarely pick up brand new retail drives (as I am cheap) all the drives currently in use have been either shucked from second hand external drives picked up from eBay or other sites. If you bargain hunt this keeps costs much lower but obviously has inherent risks with not knowing the drives history.

 

Backup:

My 412+ is has been effectively retired and now is used for backing up important data, I also keep archives of my photos offsite at work. The 412+ has 6TB of space as I tend to use smaller retired drives in it. I also have a HP Microserver which I just have to play around with, that has a real mish mash of ancient drives from 250GB to 320GB.

 

Photo's:

[timdine]

On 1/17/2019 at 6:51 PM, MediaMan said:

I know Externals do not count, but I prefer them tbh.  Never had a single problem with any of my externals, whereas ive had some problems with Internals.  All in all, while I don't expect to be counted, am at 231TB.

How do you have the externals hooked up?  You're not running 231TB of USB drives are you?

[timdine]

Updated the repo with systems up to now.  I'll generate some new lists from that.

[jonesbooned]

Hardware

• Motherboard: ASRock - Z77 Pro4-M
• CPU: Intel® Xeon® CPU E31245 @ 3.30GHz
• CPU cooler: Intel Stock
• GPU: None
• RAM: 24GB Random DDR3 1066MHz
• PSU: Unknown 750W Gold
• Boot drive: Random 16gb Flash Drive
• Storage drives: 2x4TB Seagate NAS
• Storage drives: 10x8TB WD Easystores
• Storage drive: 1x10TB WD Easystores
• Cache drive: 1x512TB Crucial SSD
• Case: Rosewell 12 bay hot swap + Unknown Max ATX Case

Total capacity: 98TB (raw), 80TB useable, Score: 80 * ln (13) = 205.195948597

 

Software and Configuration:

Running unRAID for 4 years now. Moved from ubtuntu RAID 5 and never looked back (only x3 4TB drives then). WD drives are in a rosewell 4U case with the rest of the main hardware, then using external SAS expansion cables and card to extend to a case I got in trade for light IT work that has 10 front 5.25" bays which I put hot swap bays in. Makes me a little nervous but for now it will work.

 

Usage:

Personal/Friends NAS, web server, Media Storage, PLEX, Docker Host.

8382 Movies, 56345 Episodes

It is an addiction, and I need to find a cheaper source of drives (best buy easystores so far).

Sits in my server room (read: laundry room) on a spare bar stool which has my linux sandbox and router (thinkpad T60) on the lower foot stools.

 

Backup:

Backing up to GDrive, 12/80TB so far. Maybe in a few years it will be done.

 

 

Photos:

[SakuraChan]

alright time for an update 161TB storage with 2x4U servers filled with 48x4TB drives, 2 pools, both Hardware RAID6

 

48x WL4000GSA6472E  (White Label Enterprise drives from GoHardDrive.com)

[Brian Furious]

@SakuraChan What's the power consumption?

[MariusJS]

Update; Changed out my whole build with a SuuperMicro one;

 

Running Ubuntu.

2xE5-2620 v2

32GB RAM

 

 

6x8TB Seagate NAS in Raid 6

 

+

6x4TB HGST and 4x6TB IronWolf NAS in JBOD

 

Total raw storage is 88TB with 16 drives

 

 

Old post here