Jump to content

100TB+ Server build log (151TB to be precise)

looney
By looney
in Build Logs
 Share
Posted

roughly the same price per TB as my new server :)

Also, a raid 1 on the ssd's as boot (server 2012 and linux) and raid 6 hdd so only 36tb of storage.

Link to comment
Share on other sites
Link to post
Share on other sites
Posted

If you would fill thath with porn and we say 1h is 1gb it would be 17,2 years of pron... not that much i guess

  • CPU: Intel i7 4790K watercooled & custom IHS, Motherboard: Asus Maximus VI Impact, RAM: Kingston HyperX LP 1833, 2x8GB, GPU: Asus RTX 2070 watercooled

Case: Phanteks Enthoo Evolv ITX, Storage: 1x WD Black 4TB HDD, 2x WD Blue 1TB SSD in Raid 0, PSU: Seasonic 650w Gold, Cooling: all watercoold with 2x 240 slim Rads, 5 Lian-Li Unifans

Link to comment
Share on other sites
Link to post
Share on other sites
Posted

Looks awesome. Followed.

Rig CPU Intel i5 3570K at 4.2 GHz - MB MSI Z77A-GD55 - RAM Kingston 8GB 1600 mhz - GPU XFX 7870 Double D - Keyboard Logitech G710+

Case Corsair 600T - Storage Intel 330 120GB, WD Blue 1TB - CPU Cooler Noctua NH-D14 - Displays Dell U2312HM, Asus VS228, Acer AL1715

 

Link to comment
Share on other sites
Link to post
Share on other sites
Posted

Oh looney. I worry about you sometimes.

Main rig on profile

VAULT - File Server

Spoiler

Intel Core i5 11400 w/ Shadow Rock LP, 2x16GB SP GAMING 3200MHz CL16, ASUS PRIME Z590-A, 2x LSI 9211-8i, Fractal Define 7, 256GB Team MP33, 3x 6TB WD Red Pro (general storage), 3x 1TB Seagate Barracuda (dumping ground), 3x 8TB WD White-Label (Plex) (all 3 arrays in their respective Windows Parity storage spaces), Corsair RM750x, Windows 11 Education

Sleeper HP Pavilion A6137C

Spoiler

Intel Core i7 6700K @ 4.4GHz, 4x8GB G.SKILL Ares 1800MHz CL10, ASUS Z170M-E D3, 128GB Team MP33, 1TB Seagate Barracuda, 320GB Samsung Spinpoint (for video capture), MSI GTX 970 100ME, EVGA 650G1, Windows 10 Pro

Mac Mini (Late 2020)

Spoiler

Apple M1, 8GB RAM, 256GB, macOS Sonoma

Consoles: Softmodded 1.4 Xbox w/ 500GB HDD, Xbox 360 Elite 120GB Falcon, XB1X w/2TB MX500, Xbox Series X, PS1 1001, PS2 Slim 70000 w/ FreeMcBoot, PS4 Pro 7015B 1TB (retired), PS5 Digital, Nintendo Switch OLED, Nintendo Wii RVL-001 (black)

Link to comment
Share on other sites
Link to post
Share on other sites
Posted

 

-snip-

Ok, two questions:

1) Why no GPU?

2) How do you make the pretty text version of a PCPP list?

My arsenal: i7-9700k Gaming Rig, an iPhone, and Stupidity.

Link to comment
Share on other sites
Link to post
Share on other sites
Posted

Ok, two questions:

1) Why no GPU?

2) How do you make the pretty text version of a PCPP list?

Itx so the only pcie slot is raid card. Use i7 gpu.

Hit export/ markup and do bbc code.

041353bebf.png

 

Now copy and paste

 

8102e9583b.png

Link to comment
Share on other sites
Link to post
Share on other sites
Posted

Awesome build.

 

I will end up making 2 arrays:
RAID-60 array with 32x4TB and a RAID-5 array with 4x4TB which leaves one 4TB as a global hot spare.

 

Just curious, what would be the reason behind setting up these two arrays ? Global hot spare means that it can be used as a spare for both arrays I assume ?

 

1x LSI MegaRAID SAS 9286 8e SGL 8
 

Any particular reason for picking this card ? Looking at the specs, it supports up to 240 SAS/SATA drives and External JBOD Expansion. Will this allow you to buy another Supermicro SC847 E16-RJBOD1 in the future to expand and add more drives until 240 drives? Also, how do you connect the two servers together ?

Link to comment
Share on other sites
Link to post
Share on other sites
Posted

I also received 3 out of 33 hard-drives, in total the system will have 37 4TB drives though as I will reuse 4 from my old server.

I will end up making 2 arrays:

RAID-60 array with 32x4TB and a RAID-5 array with 4x4TB which leaves one 4TB as a global hot spare.

Oh my, the sequential performance on that RAID 60! I hope your controllers can keep up!

 

You should become a cloud hosting service, store lots of VMs on this.

I do not feel obliged to believe that the same God who has endowed us with sense, reason and intellect has intended us to forgo their use, and by some other means to give us knowledge which we can attain by them. - Galileo Galilei
Build Logs: Tophat (in progress), DNAF | Useful Links: How To: Choosing Your Storage Devices and Configuration, Case Study: RAID Tolerance to Failure, Reducing Single Points of Failure in Redundant Storage , Why Choose an SSD?, ZFS From A to Z (Eric1024), Advanced RAID: Survival Rates, Flashing LSI RAID Cards (alpenwasser), SAN and Storage Networking

Link to comment
Share on other sites
Link to post
Share on other sites
Posted

this is going to be nuts!!  Can't wait to see the pics.  I have 8.19 TB in my Raid5 pool and I'm having trouble filling it.  Need more Pron then.  LOLz.  I can't imagine 151TB

My build:  Leviathan  Case: 900D  CPU: i7 3770K (watercooled)  Mobo: Z77X-UD5H GPU: EVGA GTX 780 Hydro Copper GPU: MSI GTX 780 watercooled PSU: EVGA 1300W G2  RAM: 32 GB Corsair Vengance  HDDs: 1 x 120 GB Intel 330 SSD (OS X); 1 x 256 GB Samsung 840 pro (Windows 8); 2 x 2TB Seagate Barracuda (RAID 0 Data OS X); 1 x 3TB Seagate Barracuda (OS X backups)  Monitors: 1 x 24" Apple LED Cinema (center); 2 x 23" Apple LED Cinema (surround)  Watercooling: 3 rads, CPU, GPU, GPU, MCP655 pump, Lots of fittings, EK reservoir, EK UV Blue coolant.  Updated build: Leviathan 2.0

Link to comment
Share on other sites
Link to post
Share on other sites
Posted

What OS are you going to run it on? I noticed you were running it on Windows Server 2012 on that SS for your last server. Still gonna do the same for this one?

Link to comment
Share on other sites
Link to post
Share on other sites
Posted

Bro, that is some serious shit. How do you get that money? Microsoft donations or something? How much did you invest in this machine? 

Link to comment
Share on other sites
Link to post
Share on other sites
Posted

I guess you have some spreadsheets with calculations regarding price per Gigabyte, expected  Power use. Go hit us with some datacenter-esque stats!

 

Just did some quick and dirty calculations and the grand total comes out to around 15k €. Speaking in terms of private Computers that is amazingly expensive. But on the other hand it only gets you half a Mercedes C-Klass without any options.

 

I mean let's compare it to a car. It is not that expensive. And the yearly running costs might be lower. Setting a German energy price the grand total for energy works out to over 6K a year. Soooo again: mighty expensive for a computer. But speaking in terms of car (which some people get just for fun) that's affordable.

Link to comment
Share on other sites
Link to post
Share on other sites
Posted

I guess you have some spreadsheets with calculations regarding price per Gigabyte, expected Power use. Go hit us with some datacenter-esque stats!

Just did some quick and dirty calculations and the grand total comes out to around 15k €. Speaking in terms of private Computers that is amazingly expensive. But on the other hand it only gets you half a Mercedes C-Klass without any options.

I mean let's compare it to a car. It is not that expensive. And the yearly running costs might be lower. Setting a German energy price the grand total for energy works out to over 6K a year. Soooo again: mighty expensive for a computer. But speaking in terms of car (which some people get just for fun) that's affordable.

But you can't use it to get around

n0ah1897, on 05 Mar 2014 - 2:08 PM, said:  "Computers are like girls. It's whats in the inside that matters.  I don't know about you, but I like my girls like I like my cases. Just as beautiful on the inside as the outside."

Link to comment
Share on other sites
Link to post
Share on other sites
Posted

But you can't use it to get around

 

 

and the merc will not make pasta.

 

Maybe OP lost his wife and now has to make notes of everything she always reminded him about, hence the storage need.

Link to comment
Share on other sites
Link to post
Share on other sites
Posted
  • Author

Awesome build.

 

 

Just curious, what would be the reason behind setting up these two arrays ? Global hot spare means that it can be used as a spare for both arrays I assume ?

 

Any particular reason for picking this card ? Looking at the specs, it supports up to 240 SAS/SATA drives and External JBOD Expansion. Will this allow you to buy another Supermicro SC847 E16-RJBOD1 in the future to expand and add more drives until 240 drives? Also, how do you connect the two servers together ?

I have change my plan when it comes to the arrays, I will now put 36 4TB drives in RAID-60 with a dedicated 4TB hotspare and I will use 8 4TB drives form my old server and put 7 of them in RAID 5 while using the remaining 2TB drive as a hotspare.

The primary array is to store media, the secondary array is basically a scratch disk for data that wont be there for ever (torrents and usenet)

 

As far as the card goes, it seemed to be the best card out off all LSI cards that featured 2 SFF-8088 ports, and yes it should support daisy-chaining another JBOD though I don't think that will happen any time soon. 

 

 

What OS are you going to run it on? I noticed you were running it on Windows Server 2012 on that SS for your last server. Still gonna do the same for this one?

Most of the VM's on the VM node will be linux but on the storage node I will probably run windows server 2012 again, I'm happy with the current sofware setup on my current server so I don't see a need to change it to linux.

 

and the merc will not make pasta.

 

Maybe OP lost his wife and now has to make notes of everything she always reminded him about, hence the storage need.

Wife??? dude, I'm 21... :P

 

 

 

 

Small update:

I Haver received most of the parts by now and have started building it making photos as I go along.

I'm a bit to busy right now to update the build-log daily so I will update it after most of the work is done.

 

I will give you 4 teaser pics though:

 

teaserpallet.JPG

teaserbox.JPG

teaserserver.JPG

teaserjbod.JPG

Respect the Code of Conduct!

>> Feel free to join the unofficial LTT teamspeak 3 server TS3.schnitzel.team <<

>>LTT 10TB+ Topic<< | >>FlexRAID Tutorial<< | >>LTT Speed wave<< | >>LTT Communies and Servers<<

Link to comment
Share on other sites
Link to post
Share on other sites
Posted
  • Author

Those Xeons are truly drool-worthy!

I preferred the look of those SSD boxes :P

 

But then again I do like storage and I love Samsung SSD's:

IHEARTSAMSUNGSSDS.JPG

Respect the Code of Conduct!

>> Feel free to join the unofficial LTT teamspeak 3 server TS3.schnitzel.team <<

>>LTT 10TB+ Topic<< | >>FlexRAID Tutorial<< | >>LTT Speed wave<< | >>LTT Communies and Servers<<

Link to comment
Share on other sites
Link to post
Share on other sites
Posted

If only I could afford dual xeons for rendering... xD

Edit: quad

Thats that. If you need to get in touch chances are you can find someone that knows me that can get in touch.

Link to comment
Share on other sites
Link to post
Share on other sites
Posted

Oh man theres sooo much awesome stuff.

Rig CPU Intel i5 3570K at 4.2 GHz - MB MSI Z77A-GD55 - RAM Kingston 8GB 1600 mhz - GPU XFX 7870 Double D - Keyboard Logitech G710+

Case Corsair 600T - Storage Intel 330 120GB, WD Blue 1TB - CPU Cooler Noctua NH-D14 - Displays Dell U2312HM, Asus VS228, Acer AL1715

 

Link to comment
Share on other sites
Link to post
Share on other sites
Posted

Cause he was driving round town with parts I love and I'm like fk you and do the parts 2

Link to comment
Share on other sites
Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
 Share
Go to topic listing Build Logs

×