Jump to content
Search In
  • More options...
Find results that contain...
Find results in...
looney

LTT Storage Rankings

Recommended Posts

UPDATE 2

I've managed to somehow use 4TB in the last year since upgrading, so I've had to upgrade yet again. Unfortunately, I was wrong in thinking that you could easy add 2 more drives to a raid z and have it automatically expand. Instead, I had to add another 3x3tb drives, in another raid z to expand the volume. Have to learn these things somehow! I went with 3TB WD Blue drives for $164 NZD each. A total of $492 NZD, or ~$340USD. So the upgrade costed more than expected, but ah well. I plan on eventually building some form of backup solution, at which point I'll backup all the data, and reconfigure the disks in either a raidz or raidz2 and then copy all the data back to it. For now however, this solution is sufficient and provided me with an additional 6TB of storage. I also upgraded the boot drive from an old 8gb flash drive I bought in 2008 for $80 (I have no idea how this thing is still working), and replaced it with 2x8GB USB 3.0 drives which are mirrored. The web UI environment for freenas is certainly much snappier now which is good. It was slowly getting slower and slower and I wanted to replace the boot drive before it died. Even though the process of a fresh reinstall was intimidating, restoring from the small config backup file actually put everything back exactly the way it was beforehand, so the upgrade was actually a breeze. 

Also recently upgraded to 16GB of ram, taking advantage of my friend visiting America and bringing back some stuff for me. Server is much happier with the 16gb of ram in there!

My cache drive has been removed, as i only have 6 sata ports and now have 6 hard drives. I don't mind, given that it didn't seem to have any affect for me at all anyway and was basically going to waste. 

 

My server hardware is now as follows:

 

Hardware

CASE: Zalman Z1
PSU: Some cheap thing I salvaged. (I really need to upgrade this. Unfortunately power supplies are a huge rip off in NZ)
MB: Gigabyte B85M-D3H
CPU: Intel Core i3 4130 3.4Ghz
HS: Stock Intel heatsink
RAM: 16GB DDR3 1333
HDD 1: 3x 3TB WD Green WD30EZRX (Main RAIDZ Array)
HDD 2: 3x3TB WD Blue WD30EZRZ (also in a raidz array)


Software, Configuration & Usage:
My server is running Freenas, with the 3x3TB drives in one RAIDZ array, and another 3x3TB drives in another RAIDZ array, with 11.5TB of usable storage after redundancy and formatting, and 18TB of raw storage. 500GB of this volume is dedicated to time machine backups for the 2 MacBooks and my main Hackintsoh.  The server is running plex to manage all my media and lets me stream it throughout the house, and I also share it with a few of my friends. I've recently set up Sonarr to automatically download my TV shows, and couch potato to download movies automatically for me. These download using SabNZBD mainly to take advantage of my 100mbps (hopefully soon to be 200/200) connection, and also transmission for torrents. I also have Syncthing running to sync files locally to my laptop and hackintosh so I don't need to rely on always being connected to my network to access some of my important files. 

Backup:
No current backup. Currently looking into either building a backup solution (potentially a raspberry pi with a couple large external HDDs, or something else with faster networking capabilities), or potentially crashplan. Though I've been unsuccessful at setting up crashplan thus far. 

Additional info:
When I first built this server in 2013, I had it running windows server, with 2x1TB drives in Raid 0. I was using some cheap ASrock board, and a pentium G2020. The server ran great, and the G2020 handled transcoding really well - I never noticed any hiccups. However when I upgraded, I wanted to replace the boot drive (an old 250GB drive I'd salvaged), with a 64GB SSD. When trying to clone the old drive to the new SSD, I accidentally wiped the boot drive, and had to figure something out. I decided to try Freenas. I installed windows 8, moved my data to an external, sourced an old 1TB green drive from an old external drive my dad no longer used, and set up freenas. I now had a 64GB SSD to do something with, so I decided to use it as a cache. The server has come a long way since then. With now 18TB of raw storage, 16GB of ram, an i3 and mirrored boot drives. 

 

I have all of this set up in the "server wardrobe", aka the wardrobe in my "office". I have no new interesting pictures of the server itself (you can see old ones in my previous post here. However here is an image of the server "wardrobe" as a spoiler:

 

Spoiler

large.IMG_0869.JPG

 

I do however, have a picture of the closet in case anybody is interested. I also aquired a very ancient UPS which I'm using for fun. However unfortunately it's from the 90s and only has a serial port, and cannot get it to work with freenas and a serial to USB adapter. But that's fine. Not really necessary anyway. My router is a Netgear Nighthawk R7000 which I love to bits. Used to have 3 different access points around the house. Since then moved into a smaller house and just bought a single fantastic router. I regret nothing, I'm getting the best speeds ever. I get 130MBPS down, 25MBPS up. I pay for 100/20 (and with the stock ISP router, that's all I used to get). 

 

You may also notice the raspberry pi on top of the server. If you're interested this is currently being used to automate the lighting in my house, and is used to control my lighting with amazon dash buttons. I may also end moving it elsewhere and using it as a backup server for the main server, and attach a couple external HDDs. This solution would be quite cheap, but would be quite slow with only USB 2.0 and 100mbps ethernet. 

 

Total Raw Capacity: 18TB

Total Formatted Capacity: 11.5TB

 

 


CPU i5 4430 3Ghz | Ram: 16GB DDR3 1600 | GPU: GTX 650 Ti 1GB | Mobo: H87N-Wifi | Case: White Bitfenix Prodigy | Boot Drive: 120GB 840 Evo (Mac OS X) 120gb OCZ Vertex 3 (Windows) | Games Drive: 640GB WD Green | OS: Windows 8 & OS X 10.9.1

I love all technology. The perfection of macs for my designer side, and the hardware and fun of tinkering on the of the pc side. We can have it all, just not at the same time.

Link to post
Share on other sites

Here is my new all-in-one whitebox server. It acts as my router, server, NAS and gaming computer.
 

Raw storage: 63TB
Usable: 42TB
 

OS: ESXi6.0
NAS OS: debian 7 openmediavault + LSI SAS3008 HBA (IT) passthrough + mergerfs + snapraid 
 

Boot: SanDisk 32GB Extreme CZ80 USB 3.0
Datastore#1: SAMSUNG 850 EVO 500GB
Datastore#2: 5TB WD Black
Storage: 5 x 8TB Segate SMR archive
Storage: 6 x 3TB Segate PMR
 

Case Fan: 3 x COUGAR CF-V12HPB 120mm
Case Fan: 2 x SilenX EFX-08-15 80mm fans
CPU Cooler: Noctua NH-U9DXi4 90mm SSO2
PSU: CORSAIR AX series AX760 760W ATX12V
Motherboard: SUPERMICRO MBD-X10SRH-CLN4F-O
RAM: 2 x Kingston 16GB DDR4 KVR21R15D4/16
GPU: MSI Radeon HD 6950 DirectX 11 R6950 Twin Frozr 
CPU: Intel Xeon E5-2670 v3 (ebay)
 

Case: SUPERMICRO 846E16-R1200B (ebay)
Case Backwindow: Norco 4224_backwindow
Case Fanwall: Norco 120mm fan wall: ASIN:B0075790SO

7ZQFKiM.jpg

33d9Rp7.jpg
After the fan/case mods the server is dead silent. The only time I can hear it is when the GPU fan kicks in. 

j6Exr0w.jpg
Server only uses 150 Watts at idle. When my desktop VM is running it uses around 200 watts due to the GPU power draw. 

drAaUC8.jpg
I had to mount the WD 5TB Black drive inside the case because everything connected to the SAS controller gets passed through to the Openmediavault VM. I use the Black drive as backup for the VMs on the SSD. I also use it for jobs too large for the SSD.

pMLuS5W.jpg

3MNLjaF.jpg
I could only plug in one of the SAS cables because the GPU is in the way. In the future I will get a smaller GPU or just build a new gaming computer.

9jfZfXw.jpg

WGQ3BWk.jpg
It's not a perfect fit, but it gets the job done. I have 4 large screws securing the backwindow to the case.

OBJyWYa.jpg
GPU passthrough worked on first try without any issues. I gave this VM 24 cpus just so i could take a picture of Task Manager.

CcQj2wB.jpg
Here is my snapraid config. I'm using two 8TB archive drives for parity.

79oZEEl.png
It turns out it's tricky to turn on a desktop VM. My solution was to standup a small webserver that runs a PHP script to SSH into the esxi host to turn on/off my desktop. It's not the most secure solution but it works for now.

7ZQFKiM.jpgKitty likes the new server.

Link to post
Share on other sites
Quote

It turns out it's tricky to turn on a desktop VM. My solution was to standup a small webserver that runs a PHP script to SSH into the esxi host to turn on/off my desktop. It's not the most secure solution but it works for now.

 

I'd love to know more about how you accomplished this, a look at the php code you used would be great, after removing your personal details obviously :)

 

Cheers

Link to post
Share on other sites
1 hour ago, RageInvader said:

 

I'd love to know more about how you accomplished this, a look at the php code you used would be great, after removing your personal details obviously :)

 

Cheers

Here are all the files I used for this. Hope it helps.
 

turnOnDesktopVM.zip

Link to post
Share on other sites
18 minutes ago, raid0yolo said:

Here are all the files I used for this. Hope it helps.
 

turnOnDesktopVM.zip

Thanks thats fantastic, adapted it and got it working on my unRAID server, now my girlfriend can start her gaming VM without logging into the webUI and me fearing she's going to break something.

 

Link to post
Share on other sites

Wait, I've got that same case. I ended up removing the fan wall and laying some 140MMs across the spot where it was, do you mean that I can just buy the Norco 120mm fanwall and it'll mount up where the supermicro fanwall went, or will I have to drill?

Same for the rear panel, that can be replaced as well?

On 5/4/2016 at 1:41 PM, raid0yolo said:

 

Link to post
Share on other sites
1 hour ago, Chaosratt said:

Wait, I've got that same case. I ended up removing the fan wall and laying some 140MMs across the spot where it was, do you mean that I can just buy the Norco 120mm fanwall and it'll mount up where the supermicro fanwall went, or will I have to drill?

Same for the rear panel, that can be replaced as well?

To use the Norco parts you definitely need to drill some holes. I drilled four holes to secure the rear panel. You can see three of the four screws if you look carefully at the pictures above. I only drilled one hole to secure the fanwall + a zip tie because it's so light weight. If you decide to installed the Norco back window I would recommend having a motherboard and a graphics card installed to help in aligning the case with the back window before drilling any holes.

IMG_0477.jpg - Shows the ~1/4 inch gap on the left side of the backwindow. I used a few bolts and spacers to fill the gap.
IMG_0479.jpg - Shows the one screw I used for the fan wall. Zip ties were also used, but not shown.
IMG_0482.jpg - Shows how the power supply does not line up with the with back window mounting holes. I ended drilling the PSU holes larger so they would meet up with the power supply screw holes.

IMG_0477.JPG

IMG_0479.JPG

IMG_0482.JPG

Link to post
Share on other sites

So I've completely swapped out my system

 

Got a R510 for free 

Also bought some new disks :D

 

Hardware: 

Case: Dell R510

Xeon E5620 8 Thread  CPU

32GB of ECC RAM

OS Disk: 250GB Samsung 840 Evo

 

STORAGE:

Raid card: Dell Perc h700

4x HGST 4TB Raid 5

2x WD Red 4TB Raid 5 (With the HGST's)

3x WD Surveillance 3TB Raid 5 (With the WD red's)

1x Seagate 8TB

 

Storage not in use ATM

6x Seagate 2TB

9x Dell/Seagate Constallation 1TB

2x Samsung 845 800GB SSD's

 

Info:

Running in Raid 5's and using Windows Server 2012 R2 (sadly) to manage and share the disks + for other purposes

About 31TB of usable space, and 41TB Raw space

Don't know what more there is to write really, ask me if there is something left out :P

 

Pics: 

Theese are the new ones :D

2016-05-13 19.08.03.jpg2016-05-13 19.17.51.jpg

Got them installed!

2016-05-13 19.21.55.jpgimg (1).pngimg.png

Old/not in use drives:

2016-05-13 19.07.06.jpg2016-05-13 19.07.13.jpg


Network/Homelab build log Main PC: "Aqua Blue"  Server: 15TB+ "Blue Lightning"

1800x, 32GB RAM, 2x1080Ti, 2.5TB+ SSD Storage, 3x2560x1440 and 1x1920x1200 monitor

My website: http://mariusjs.me/

Link to post
Share on other sites

Oh man, Just completed a computation / storage server that no longer can fit in this thread, would've been fine when it was just 10TB+ :(

I have 3x 8TB Drives, at some point I will fit in this thread :/ 


CPU: i7 5820K 4.0GHz @1.15V | MOBO: Asus X99 Sabertooth | GPU: Gigabyte Windforce GTX 980Ti, LTT Orange | CASE: NZXT H440 Black 2015 | COOLER: Noctua NH-D15S w/ LTT Fans | RAM: 32GB Patriot 3000MHz | STORAGE: 512GB Samsung 950 Pro, 960GB Sandisk Ultra II 3 x 8TB Seagate HDD's | PSU: 750W Seasonic X series, black / orange cablemod cables| Monitors: 3x Asus VX24AH's | AUDIO OUT: Microlab SOLO 8C, Sennheiser HD 650's, Audio engine D1 Amp / DAC | AUDIO IN: Blue Snowball | Keyboard: CM Storm QuickFire TK MX Green | Mouse: Logitech G900 Proteus Spectrum + RSI Extended Mouse Pad | PCPP Linkhttp://nz.pcpartpicker.com/list/hPjFd6

Link to post
Share on other sites
13 hours ago, Str_Mape said:

Oh man, Just completed a computation / storage server that no longer can fit in this thread, would've been fine when it was just 10TB+ :(

I have 3x 8TB Drives, at some point I will fit in this thread :/ 

Submit it anyway, you'll get put in the section for interesting builds, and then later one when you update it, most of the work will be done already.


Looking to buy GTX690, other multi-GPU cards, or single-slot graphics cards: 

 

Link to post
Share on other sites
On 3/23/2015 at 10:20 PM, Stakacs said:

 

@alpenwasser Update #2

 

Hardware
CASE: Fractal Design Define R5

PSU: EVGA SuperNova 750 G2 750W
MB: ASrock Z87 Extream6/ac
CPU: Intel i7 4790
HS: Corsair H90
RAM: Corsair Vengeance Pro 32GB DDR3 1600
SSD: Transcend 512 GB SATA III
HDD 1: 3x 3TB Seagate NAS HDD ST3000VN000
HDD 2: 3x 3TB Seagate Barracuda ST3000DM001

HDD 3: 2x 3TB  HGST HDN724030ALE640

 

Software and Configuration:
 Server is running Unraid 
Array consists of 7x3TB for Raw Storage + Parity Drive & SSD for Cache

 

Usage:

Plex & Storage

Additional info:
300/30 internet Mbps connection

Modem, Router and Server  - Collectively Idle @ 50 ish watts

Back up power - APC BE750G

Drive Bay was converted to Evercool Dual 5.25 to Three 3.5 HDD with a 80MM fan

Photo's:

Unraid 18 May 2016.jpg

 

 

Link to post
Share on other sites
On 5/19/2016 at 0:16 PM, Mikensan said:

Are you sure about that power consumption @Stakacs? The computer alone should idle close to 40watts without a dedicated graphics card and 1 drive. 

This system is headless, and all drives while idle are spun down within Unraid. CPU is at 1% usage. 

 

Saying that I am sure that it is exactly 30 Watts, No. I have not taken my Unit to work to Calibrate it. Maybe I will do that soon and get back to you with a tolerance. 

 

Also for Clarification this watt reading is measured by the APC.

 

Take care,

 

ST

 

Power Usage.jpg

 

 

Link to post
Share on other sites

Terribly sorry for the long delay; this semester's been kinda crazy, and I had the great idea to fall ill twice, which didn't help with having spare time to hang around on the forums at all. Anyway:

On 3/19/2016 at 7:09 PM, Eric The Tech Guru said:

So I've posted before but I've kinda made a bunch of revisions to my server.

 

On 3/21/2016 at 3:30 PM, Jonny said:

WinterFell (Centos 7)

 

On 3/27/2016 at 5:43 PM, scottyseng said:

@alpenwasser:

I've added two more 4TB Re SAS drives to my NAS. Now have four 4TB Re SAS drives in RAID10 instead of the existing two 4TB RAID0.

 

On 3/29/2016 at 1:01 AM, Kiades said:

 

 

On 3/29/2016 at 9:31 AM, mGrytbak said:

Update! *yay*

 

 

 

Added/updated.

 

On 4/10/2016 at 3:22 AM, Pancake said:

How do I update my ranking? I am currently sitting at 29TB. My setup has changed a lot lately

 

Specs of my main ESXi Server:

E3-1265L V2, 32GB ECC, Supermicro Server board with IMPI and Dual lan etc, Samsung 850 Pro 512GB, iStarUSA 213 2u Case, ICY DOCK 6 x 2.5" Hotswap bay, 430w Antec Earthwatts PSU

Specs of my second ESXi Server:

i3-3220, 32GB ECC, Supermicro Server board with IMPI and Dual lan etc, Crucial MX100 256GB, iStarUSA 213 2u Case, ICY DOCK 6 x 2.5" Hotswap bay, 430w Antec Earthwatts PSU, And a Dual Port Intel Pro1000 NIC for pfSense (Used as my main router)

 

 

 

You pretty much got it. Just make a new post with the updated info. I'm not yet 100% sure what your drive config is though. You now have two machines, each with six 2.6" drives? You wouldn't happen to have the vendor for those drives by any chance? I'll update you ASAP once I'm clear on what's what. Thanks!

 

On 4/10/2016 at 3:52 AM, thekeemo said:

I know this is off topic I am sorry

but how do you make tables and graphs in this? also headers.

I think we can tolerate some off-topic chit-chat. Besides, it's sorta on topic. ;)

 

Anyway, the way you do that is by getting HTML editing privileges. Sadly, can't really enable that for regular users for security reasons.

 

On 4/27/2016 at 10:57 PM, dalekphalm said:

 

 

On 4/29/2016 at 7:17 AM, AidanJMessenger said:

 

 

 

 

On 5/4/2016 at 7:41 PM, raid0yolo said:

Here is my new all-in-one whitebox server. It acts as my router, server, NAS and gaming computer.

 

 

 

On 5/6/2016 at 7:56 PM, raid0yolo said:

 

 

On 5/13/2016 at 9:43 PM, MariusJS said:

So I've completely swapped out my system

 

 

On 5/17/2016 at 10:08 PM, Str_Mape said:

Oh man, Just completed a computation / storage server that no longer can fit in this thread, would've been fine when it was just 10TB+ :(

I have 3x 8TB Drives, at some point I will fit in this thread :/ 

 

On 5/18/2016 at 11:30 AM, brwainer said:

Submit it anyway, you'll get put in the section for interesting builds, and then later one when you update it, most of the work will be done already.

^This. thumb.gif

 

On 5/19/2016 at 4:44 AM, Stakacs said:

 

Updated/added.

 

Thanks for participating, everyone!


BUILD LOGS: HELIOS - Latest Update: 2015-SEP-06 ::: ZEUS - BOTW 2013-JUN-28 ::: APOLLO - Complete: 2014-MAY-10
OTHER STUFF: Cable Lacing Tutorial ::: What Is ZFS? ::: mincss Primer ::: LSI RAID Card Flashing Tutorial
FORUM INFO: Community Standards ::: The Moderating Team ::: 10TB+ Storage Showoff Topic

Link to post
Share on other sites
On 10/01/2016 at 10:27 PM, MyNameIsNicola said:

Hardware
CASE: Supermicro SuperChassis 847A-R1400LPB
PSU: 2x 1400W high-efficiency (1+1) redundant power supply with PMBus

MB: Supermicro X9DRH-IF

CPU: 2x Intel® Xeon® CPU E5-2603 v2 @ 1.80GHz

HS: 2x Active Supermicro SNK-P0048AP
RAM: 80GB ECC DDR3 1333
RAID CARD 1: LSI 9211-8i 6GB/s SAS HBA w/"IT" firmware
RAID CARD 2: LSI 9211-8i 6GB/s SAS HBA w/"IT" firmware
RAID CARD 3: LSI 9211-8i 6GB/s SAS HBA w/"IT" firmware
RAID CARD 4: LSI 9211-8i 6GB/s SAS HBA w/"IT" firmware
RAID CARD 5: LSI 9211-8i 6GB/s SAS HBA w/"IT" firmware
SSD 1: 2x 120GB Kingston SV300S37A120G SSD (FreeNAS boot volume)

SSD 2: 2x 500GB Samsung 850 EVO SSD (jails and virtual machines)

...

...

...

 

Mini Update

 

I needed to expand my archive pool to be able to properly backup my primary data pool1, so I swapped out the single 4TB pool2 disk for an additional 8TB disk to extend archive (which nicely tips me over 150TB of raw storage - woot). ;-) -- mdBDyTV.png

 

I've also now got a better solution for UPS, with a 2U rack mount APC Smart-UPS 1000 watt / 1500 VA, which is currently sitting at 55% load. Feels much better now. Phew.

VUvgpKA.jpg

 
(120 GB) + (120 GB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (3.00 TB) + (4.00 TB) + (4.00 TB) + (4.00 TB) + (4.00 TB) + (500 GB) + (500 GB) + (8.00 TB) + (8.00 TB) + (8.00 TB) + (8.00 TB) + (8.00 TB) + (8.00 TB) + (8.00 TB) + (8.00 TB) =
TOTAL RAW STORAGE: 153.24 terabytes
 
(57 TB) + (111 GB) + (460 GB) + (76 TB) =
TOTAL USABLE STORAGE: 133.57100 terabytes

WWW: https://nicolaw.uk   CASE: Supermicro SuperChassis 847A-R1400LPB   MBSupermicro X9DRH-IF   CPU2x Intel® Xeon® CPU E5-2603 v2 @ 1.80GHz   RAM: 80GB ECC DDR3 1333   NICIntel E10G42BFSR X520-SR2   HBA: 5x LSI 9211-8i 6GB/s SAS HBA 'IT' Firmware   HDD/SSD2x 120GB Kingston SV300S37A120G SSD 2x 500GB Samsung 850 EVO SSD 8x 8TB Seagate ST8000AS0002-1NA17Z 21x 3TB Hitachi HGST HDN724030ALE640 4x 4TB Hitachi HGST HDS724040ALE640 3x 3TB Western Digital Red WDC WD30EFRX-68AX9N0

Link to post
Share on other sites

@alpenwasser

I added five more 4TB WD Re Drives. Now in total:

Six 4TB WD Reds

Nine 4TB WD Re SAS drives

 

Now to wait for the RAID6 array of the nine 4TB drives to build...

 

Also sad to hear you got sick through the semester...I remember getting sick myself a year back and I didn't do well in my classes as a result..

Link to post
Share on other sites

After my partshift I am having two entries.

 

naster.maxcrib.info:

Hardware

CASE: Unknown brand (old case reused)

PSU: AcBel API6PC05 (250W nom.)

MB: Asus P5BV-C

CPU: Intel Core 2 Quad Q9300

HS: Lenovo OEM heatsink

RAM: 4x 2GB DDR2-800 ECC SDRAM = 8GB

RAID CARD: Adaptec 6805

HDD 1: 4x 3TB WD Red WD30EFRX-68EUZN0 = 12TB

HDD 2: 1x 3TB Hitachi Ultrastar HUA5C3030ALA640

Software and Configuration:

Stock Ubuntu Server 16.04 LTS amd64.

RAID card configured as a 5-drive RAID-6. (currently rebuilding the original 3-drive RAID-5 with a hot spare before expansion can be made.) Effective capacity 9TB.

Usage:

This machine hosts my backups, multimedia and a lot more. It is a router/NAS multipurpose device.

Backup:

This device have a cron job copying the bulk of its data over to an Apple Time Capsule at the other end of my apartment hacked with 6TB HDD each week.

Additional info:

Mostly used parts and upgrade rejects.

Photo's:

maxView of the current setup:

naster-expand.png

Old pictures of the internals that still stand. Disks added to the first and fourth slot. 

IMG_0357.JPGIMG_0359.JPG

 

battleship.maxcrib.info

Hardware

CASE: Unbranded case.

PSU: HuntKey Panshi 800 (600W nom.)

MB: Asus Z9PE-D16C/2L

CPU: 2x Intel Xeon E5-2680

HS: PCCOOLER Butterfly PWM (CPU 0), PCCOOLER Yellow Sea Deluxe (CPU 1)

RAM: 8x 16GB DDR3-1600 Registered ECC SDRAM = 128GB

GPU: Zotac nVidia GTX 650 Ti 2GB

RAID CARD: LSI 3ware 9750-8i + hacked BBU

HDD: 6x 2TB WD Green (mixed generations, hacked to perform like Reds) = 12TB

Software and Configuration:

This array is configured as a RAID-6 volume providing 8TB effective storage. Runs Ubuntu 16.04 and have a few virtual machines on it.

Usage:

This is my main non-macOS workstation so it have lots of CPU, RAM, GPU and storage.

Backup:

Nowhere to backup now though. It is too large to fit anywhere.

Additional info:

The power hungry CPU and GPU puts a lot of strain on the PSU. Maybe I need to swap it out down the road, and rebuild the above machine with a dual Xeon X5400 rig.

Photo's:

Old photos from my previous entry still stand, as no storage modification is made, only usage.

 

Update:

The 3TB Ultrastar is added to the array in naster.maxcrib.info, bringing its capacity up to 15TB total. I was a fool and the array have to be rebuilt before expanding into a 5-drive RAID 6. 


Workstation 1: Xeon E3-1231v3 ~ 4x Kingston KVR 8GB DDR3-1600 ~ Gigabyte GA-Z97D-D3 ~ Sapphire RX 580 8GB ~ Samsung 960 Pro 512GB ~ WD Green 2TB ~ macOS Mojave amd64
Workstation 2: 2x Xeon E5-2680 ~ 8x Kingston KVR 16GB DDR3-1600 Registered ECC ~ Asus Z9PE-D16C/2L ~ XFX RX 480 8GB ~ WD Black NVMe 1TB ~ Windows 10 Pro Workstation amd64

Workstation 3: Core 2 Quad Q9300 ~ 4x mixed-brand 2GB DDR2-800 ~ Colorful C.P45K ~ Zotac GTX 650 Ti ~ Kingston V300 120GB ~ Samsung SpinPoint 1TB ~ Windows 10 Pro amd64
Home server: Core 2 Quad Q9550S ~ 4x Micron 2GB DDR2-800 Unbuffered ECC ~ Asus P5BV-C ~ Broadcom MegaRAID 9271-8iCC ~ Unbranded SATA SSD 120GB ~ 6x WD Green 2TB ~ 2x WD Red 2TB ~ Ubuntu Server 18.04 LTS amd64
Laptop 1: Apple MacBookPro9.2 ~ Core i5-3210M ~ 2x Samsung 8GB DDR3L-1600 SO-DIMM ~ Samsung SSD 850 Evo 1TB ~ macOS Catalina amd64

Laptop 2: Apple MacBookPro8,1 ~ Core i7-2620M ~ 2x Samsung 4GB DDR3-1600 SO-DIMM ~ Kingston SSDNow V300 240GB ~ macOS High Sierra amd64
Laptop 3: Dell Latitude D620 ~ Core 2 Duo T7600 ~ Kingston 2GB DDR2-800 SO-DIMM ~ Kingston 1GB DDR2-800 SO-DIMM ~ Intel 945PM ~ nVidia Quadro NVS 110M ~ Kingston SSDNow V300 60GB ~ Windows 10 Pro amd64

Link to post
Share on other sites

Wow, I just looked on employee store and I can grab 8TB WD Red NAS drives for $140 a piece! So tempting to order like 8 of them....


SSD Firmware Engineer

 

| Dual Boot Linux Mint and W8.1 Pro x64 with rEFInd Boot Manager | Intel Core i7-4770k | Corsair H100i | ASRock Z87 Extreme4 | 32 GB (4x8gb) 1600MHz CL8 | EVGA GTX970 FTW+ | EVGA SuperNOVA 1000 P2 | 500GB Samsung 850 Evo |250GB Samsung 840 Evo | 3x1Tb HDD | 4 LG UH12NS30 BD Drives | LSI HBA | Corsair Carbide 500R Case | Das Keyboard 4 Ultimate | Logitech M510 Mouse | Corsair Vengeance 2100 Wireless Headset | 4 Monoprice Displays - 3x27"4k bottom, 27" 1440p top | Logitech Z-2300 Speakers |

Link to post
Share on other sites
5 hours ago, Gronnie said:

Wow, I just looked on employee store and I can grab 8TB WD Red NAS drives for $140 a piece! So tempting to order like 8 of them....

Grab them, throw them into a RAID-50 array and enjoy.


Workstation 1: Xeon E3-1231v3 ~ 4x Kingston KVR 8GB DDR3-1600 ~ Gigabyte GA-Z97D-D3 ~ Sapphire RX 580 8GB ~ Samsung 960 Pro 512GB ~ WD Green 2TB ~ macOS Mojave amd64
Workstation 2: 2x Xeon E5-2680 ~ 8x Kingston KVR 16GB DDR3-1600 Registered ECC ~ Asus Z9PE-D16C/2L ~ XFX RX 480 8GB ~ WD Black NVMe 1TB ~ Windows 10 Pro Workstation amd64

Workstation 3: Core 2 Quad Q9300 ~ 4x mixed-brand 2GB DDR2-800 ~ Colorful C.P45K ~ Zotac GTX 650 Ti ~ Kingston V300 120GB ~ Samsung SpinPoint 1TB ~ Windows 10 Pro amd64
Home server: Core 2 Quad Q9550S ~ 4x Micron 2GB DDR2-800 Unbuffered ECC ~ Asus P5BV-C ~ Broadcom MegaRAID 9271-8iCC ~ Unbranded SATA SSD 120GB ~ 6x WD Green 2TB ~ 2x WD Red 2TB ~ Ubuntu Server 18.04 LTS amd64
Laptop 1: Apple MacBookPro9.2 ~ Core i5-3210M ~ 2x Samsung 8GB DDR3L-1600 SO-DIMM ~ Samsung SSD 850 Evo 1TB ~ macOS Catalina amd64

Laptop 2: Apple MacBookPro8,1 ~ Core i7-2620M ~ 2x Samsung 4GB DDR3-1600 SO-DIMM ~ Kingston SSDNow V300 240GB ~ macOS High Sierra amd64
Laptop 3: Dell Latitude D620 ~ Core 2 Duo T7600 ~ Kingston 2GB DDR2-800 SO-DIMM ~ Kingston 1GB DDR2-800 SO-DIMM ~ Intel 945PM ~ nVidia Quadro NVS 110M ~ Kingston SSDNow V300 60GB ~ Windows 10 Pro amd64

Link to post
Share on other sites

Hardware

CASE: Norco RPC4308

PSU: Corsair VX550

MB: SuperMicro X8DTH-iF

CPU: 2x Intel Xeon X5560

HS: 

RAM: 192GB DDR3 ECC REG 1066MHz (12x 16GB sticks)

RAID CARD 1: IBM M1015, Flashed with "IT" firmware

RAID CARD 2: IBM ServeRaid MR10i

HDD 1: 2x 500GB Samsung 850 EVO 

HDD 2: 8x 4TB WD Red WD40EFRX

 

Raw storage = 32TB, 8 disks.

 

Software and Configuration:

My server is running ESXi 5.5.0. A FreeNAS VM is controlling storage disks. The FreeNAS VM has the M1015 controller, two port GigE Intel network card, and a 10GigE Intel network card passed through.

 

The storage array is 8x4TB disks in a pool consisting of one RaidZ2 vdev. This amounts to ~20 TB actual usable storage space. The pool is encrypted with AES128, and keys are backed up somewhere safe.

 

The two Samsung SSDs are configured with Raid1 within the MR10i controller, used for VM storage on the hypervisor. 

 

Usage:

The server is also used for other production servers like Windows domain controller, linux database servers (for Kodi and such), splunk, mgmt-server with Veeam, monitoring services. FreeNAS acts as a backup repository for TimeMachine and personal files.

 

There are also two other windows domains used for labbing, with domain controllers, exchange, SCCM, VDI, HyperV (nested), WAP, DirectAccess and different client VMs.

 

Backup:

VMs backed up to my computer, important personal stuff backed up to remote FreeNAS server by rsync.

 

Additional info:

Currently running X5560 processors, which does not support AES-NI. I have ordered E5640's processors which does support this feature, and they come with lower TDP.

Recently upgraded from 5 to 8 storage disks.

 

Photo's:

20160620_213331.jpg

20160620_213400.jpg

20160620_213410.jpg

20160620_213658.jpg

20160704_164211.jpg

20160710_140344.jpg

Link to post
Share on other sites

Updated my post with new information and future upgrade ideas.

 


PC: Intel i7 3770k | Asus P8Z77-V Pro | Cool Master Storm Trooper | ASUS GTX 1070 Strix | 32 GB DDR3 Ram | 840EVO 500GB | 850EVO 1TB | Predator 1440p TN 165hz | Windows 10 Pro

NAS: Intel 2600k | Asus P8Z77 | 32GB DDR3 RAM | 60GB SSD (BOOT) | Ubuntu 16.04.5 | 3x 3TB + 3x10TB WD Red in ZFS Raidz1 (240GB Cache Drive) | 2x 128GB SSDs for Linux Containers

Ultralight: 2x Toshiba Z930 | 6GB RAM | 120GB SSD | One Linux and One Windows.

Link to post
Share on other sites

Not sure if this is correct, used natural log of 6 (according to Google)...  1.79175946923

 

Score: 25.44

Capacity: 14.2 TB

Drives: 6

 

 

Hardware

CASE: Supermicro SC826TQ-R800LPB

PSU: Dual Supermicro PWS-801-1R 800W Hot swap PSU's

MB: Supermicro X8DTN+

CPU: Dual Xeon E5620

HS: Dual Supermicro  SNK-P0036 or SNK-P0037P, Not sure which they are, came with chassis already installed

RAM: 4x Nanya NT4GC72B4NA1NL-CG (24GB Reg ECC DDR3), 12x MICRON MT36JSZF51272PZ-1G4G1FG (48GB Reg ECC DDR3), (72GB total memory)

RAID CARD 1: IBM M1015, Flashed with "IT" firmware

SSD: 2x OCZ Agility (60GB) (OS & Backup), 2x Q Series HDTS225XZSTA (256GB) ZIL & L2ARC mirrored - (120 gig Samsung SSD's ready to be installed and swapped out for the OS and backup drive

HDD 1: 6x WD40EFRX (4TB) in RaidZ2 (14.3 TB usable)

 

Software and Configuration:

OS: Ubuntu Server 14.04.1 LTS

Drives in Raid Z2 Array with mirrored ZIL & L2ARC SSD's

 

Usage:

Only thing main OS does is act as host OS, and has the NAS portion of things.

   Virtual host running Plex Media Server

   Virtual host running 2 Minecraft servers 24x7 (I haven't played in a REALLY long time though)

   Virtual host as a test platform

   Suggestions welcome for other things I can throw at it!!!

 

Backup:

   Personal files like photos and home videos are backed up on desktop drive and an external drive. The MAJORITY of rest of the data on there is MKV files from DVD & Blu Ray rips, (I only rip discs we own). These are backed up on two external Seagate 5TB drives

 

Photo's:

Building custom SSD drive cage for inside the chassis so they don't waste hot swap space on the front....

20150315_205530.jpg


Each drive screws into a piece of Styrene, with round styrene rods and nylon spacers around the rods to give each drive space for airflow.
20150315_203853.jpg

Here is a shot of the guts all ready to go. You can see the custom drive cage at the top.
20150401_163250.jpg


Here it is in a photo I took earlier today, It is near the top of the rack, looking at the back end here, UPS is at the bottom. 20160722_105541.jpg

Drive pool and storage space:
storage_1.png

Screenshot_2015-05-14-23-24-55.png


Gaming Laptop: - ASUS K501LX-EB71 - Stock (Wife's) - Gateway P-6860FX - Stock (Mine - Needs fixen)
General Laptop: - Sony Vaio  SVE141D1L - Stock (Mine)
Gaming Rig: BACK ONLINE!!  ASUS Z87-PRO (V EDITION), Intel Core i5-4590 Haswell (Stock Cooling), HyperX FURY 8GB DDR3 1866, XFX Radeon HD 4870, SILVERSTONE DA700, Samsung 840 500Gig SSD MZ-7TD500BW, 3 TB storage drive (3x WD 2TB Greens died on me), ASUS DRW-2014L1T (DVD), LG WH14NS40 (Blu Ray), Dell 2709W, Sony SDM-HS95P, Windows 10 Pro
The NAS Box: OFFLINE D-Link DNS-323, 0.1RC3 Alt-F firmware, 2x 7200.14 ST3000DM001 3TB EXT4 - NO RAID - 6 TB
Home Server: - Supermicro SC826TQ-R800LPB chassis, X8DTN+, Dual Xeon E5620 (Stock), 
4x Nanya NT4GC72B4NA1NL-CG (24GB Reg ECC DDR3), 12x MICRON MT36JSZF51272PZ-1G4G1FG (48GB Reg ECC DDR3), (72GB total memory), 2x OCZ Agility (60GB) (OS & Backup), 6x WD40EFRX (4TB) in RaidZ2 (14.3 TB usable), 2x Q Series HDTS225XZSTA (256GB) ZIL & L2ARC mirrored

Link to post
Share on other sites

This is my update server a very much work in progress. the fan need to run 24/7 if it stop the server shutdown from heat.

Hardware:
CASE: what this lol

PSU: Corsair HX850i 850W 80PLUS Platinum

MB: gigabyte x79-up4

CPU: Intel® Core™ i7-3820 CPU @ 3.60GHz

HS: Some heatsink I had lying around

RAM: 32GB Kingston ValueR. DDR3

RAID CARD: IBM M1115 converted to LSI9211-IT mode

HBA:  Intel RES2SV240

SSD 1: 1 x 128GB ocz vertex 4

SSD 2: 1 x 60GB ocz apex

HDD 1: 11 x 2TB drive

aLL the drives blow are are just place holders.try to get same more 8tb drives.

HDD 2: 2 x 1TB drive

HDD 3: 1 x 160 GB

HDD 5: 1 x 750 GB WDC WD20EZRX-00D

HDD 6: 1 x 250 GB GB WDC WD20EZRX-00D

HDD 7: 1 x 320 GB WDC WD20EZRX-00D

HDD 8: 1 x 82.3 GB GB WDC WD20EZRX-00D

 

             
             
             
             
   

Software and Configuration:
OS: unraid 6.2.0.21

RAID config:  RAID6

RAID hot spare: 2 x 2TB

File system: XFS for the RAID
File system capacity: Advertised:25.5TB, RAID6 Advertised 21.5TB.

 

Usage:
Storing stuff, you know, it is a storage server.

Backup:
Working on get the main server ruining

20160727_113532[1].jpg

20160728_121751[1].jpg

20160728_121746[1].jpg

20160728_121741[1].jpg

20160728_121736[1].jpg

20160728_121730[1].jpg

Capture.PNG

Link to post
Share on other sites

@Mikensan

On 5/19/2016 at 0:16 PM, Mikensan said:

Are you sure about that power consumption @Stakacs? The computer alone should idle close to 40watts without a dedicated graphics card and 1 drive. 

 

You are Right, 

 

I purchased a standalone Watt-meter and even Verified its accuracy @ work (I am a Metrologist) 

 

Servers in the low to mid 50's idle with the Networking gear also. 

 

Thanks!

Link to post
Share on other sites

@alpenwasser @looney

Any rules on distributed file systems like Ceph, Lustre and Gluster?

 

Quote
  • It has to be a single system (everything running off of a single motherboard).

 

Kinda puts a downer on my plans, not that I actually care :P. I guess each individual storage node would count but not the system as a whole?

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

Buy VPN

×