Search the Community

LTT Storage Rankings Topic Welcome to the LTT Storage Rankings! The purpose of this topic is to show off cool storage builds, to inspire with what you show and be inspired by what you see. And of course, also talk about those builds, ask their owners questions and all that good stuff. Criteria System capacity of 10 TB or more 5 storage drives or more: We don't count OS drives, we also do not count cache drives, nor external USB drives. External SAS enclosures connected via SFF-8088 count, however. Drobos, Thunderbolt enclosures etc.: If they have a management interface which makes them somewhat autonomous, they count. It does not matter whether your storage drives is an SSD or an HDD, as long as it is used for storage. Don't forget to indicate vendor and drive size for all your drives for our statistics (see also below). For cases not covered here, we reserve the right to adjust the rules as needed to protect the spirit of the thread. It has to be a single system (everything running off of a single motherboard). Do not post your company server (except the ones from Linus Media Group ;)), this is for private systems. Pictures of the hardware required. That's the primary point of this thread, after all. Use looney's post as a template. Write a nice post about your system, give us some details on the nitty gritty inner workings of your beast. Make sure to give all the needed info for the statistics (Operating system, storage system, HDD vendors and sizes etc.) Ranking System The rankings are based on ranking points, which are calculated as follows: ranking_points = system_capacity ⨯ ln(system_drive_count) with ln(system_drive_count) being the natural logarithm of the number of drives in the system. Rationales Minimum Requirements Having both the 10 TB and the 5 drive minimum rules allows us to prevent being spammed by systems with a single or two huge HDDs (10 terabyte HDDs are a reality now, after all), while still allowing systems which were put together with smaller drives (or SSDs) to get into the list. Ranking Points Basically, this thread is about awesome storage systems, and we think that capacity isn't the only thing which determines how cool a storage machine is. Chances are that a system with a bit less capacity but quite a few more drives might be more interesting to look at. Therefore, the number of drives also counts. However, we don't want somebody buying a ton of small cheap drives to outrank somebody who's bought a hugely expensive system with fewer big drives, which is why towards the upper end of the scale, the number of drives starts to no longer matter as much (see examples below). Example for Large Systems System 1: 100 TB capacity, 50 ⨯ 2 TB drives: 391.2 ranking points System 2: 150 TB capacity, 30 ⨯ 5 TB drives: 510.2 ranking points Amount of drives required for system 1 to surpass system 2, assuming capacities for both systems and drive count for system 2 stay the same: 165 drives, resulting in 510.6 ranking points. Capacity weighs much heavier than drive count as it grows, the influence of the number of drives on the ranking points falls prey to the law of diminishing returns. Example for Smaller Systems System 3: 14 TB capacity, 7 ⨯ 2 TB drives: 27.2 ranking points System 4: 15 TB capacity, 5 ⨯ 3 TB drives: 24.1 ranking points Drive count has a higher weight for such systems, system 3 ranks ahead of system 4 despite having less total capacity. Identical Ranking Points For systems with identical ranking points, post date is the ranking factor (more specifically: post number). Since no posts can have the same number, this is sufficient for unambiguous ranking. Script The rankings and plots are generated by a Python script, which can be found on alpenwasser's github here. Capacity Calculation We count raw storage as advertised on the drives. So, if you have 10 ⨯ 1 TB drives, that counts as 10 TB of storage. Smaller Systems Not everybody needs a big server, and even smaller systems can be cool and interesting (or noteworthy, as we put it below). For such systems we have a secondary list, so feel free to post your machine even if it doesn't quite meet the ranking criteria outlined above. Please still use the template post for your system, and stick to the rest of the criteria as applicable to your machine. External Sites This thread is inspired by the one on the [H]ard Forum, where you can find many huge systems as well. The Dutch thread on Gathering of Tweakers is also worth a look, although it is in Dutch, obviously. Serve the Home is also a great place for all things storage. Support/Bugs At the moment, @alpenwasser is the primary maintainer of the script and stats, so contact him about that kind of thing.

I've been thinking about building a NAS build and in my research I encountered this product: ICY DOCK 24 bay 2.5 inch hot swap to 3x 5.25 inch bay ($~800) This is intriguing; in the same space that I could fit five 3.5" hard drives with some products, this fits 24 2.5" drives, this is half a magnitude higher in density! Going a step further, any standard mid tower case with 9 5.25 inch bays could fit three of these, this makes the case capable of holding 72 2.5 inch drives! This is utter madness! (example case: Old Antec 900, though I'm sure newer ones exist.) Using the Samsung 870 QVO 8TB 2.5 inch model would grant roughly 576TB of storage, costing ~$25,200. ($349.99 on amazon) This is a huge amount of money, but it appears to be pretty fair for SSDs. But it's not done yet! 144 drives might be achievable by using 72 dual m.2 to 2.5 inch adapters like this one: StarTech.com S322M225R M.2 to SATA Adapter - Dual Slot this would allow for a petabyte to be stored. At present on PcPart Picker, the cheapest m.2 2280 8TB drive costs $759.00 a piece. This means that you could get a petabyte of storage inside of a mid-tower case for the mere cost of $109,296 in storage. A similar drive, the MP600 PRO NH states 10.9 Watts on its webpage, so the power budget would be 1,596.6 Watts, plus overhead from all other components. This is probably the hardest to accommodate part. Overall, the system would require: 24 SAS ports 2000 Watt PSU (guessing on overhead) 144 8TB M.2 drives Mid Tower Case A budget of $120,000 (rough estimate) To get: 1,152 TB of storage maximum. What do you think of this? It seems like it could work and with the power issue resolved it might be a really interesting video! Edit: I realized a much cheaper option exists here, this is not SAS which could make it pretty difficult to troubleshoot cable issues. Athena Power BP-15827SAC

If you enjoy Linus's videos about storage servers, petabyte project, etc. I reckon you might enjoy this hour long talk about how Amazon operates a storage system a few orders of magnitude larger.

So linus had a few videos of the different servers he uses and the sizes of them and i was like wow thats alot of space.... recently a video mentioned about have a petabyte storage and i just wonder, does he keep like 32 copies of each video? like whyyy is so much space needed?

Yea current plan is to use it for our SQL clusters. We're also super tied in to snapmanager, our DR totally relies on it. We also have an SQL Always-On Async Mode cluster across two cities in a multi-subnet configuration, iSCSI stretched VLAN, with snapmanager. We were told that setup couldn't be done .

I challenge Linus to make that server (to scale or calculate) to consume no more than 1.45 Watts per TB of usable space, assuming RAID-6. Rules: Max. Total TDP 1450W per PB of usable space, RAID-6. 1 CPU core = 3 HDD 1 GiB RAM/TB of raw space 3 GB of SSD (SLC, eMLC or MLC) cache per TB of raw space Has a speed of 1 GB/s write and 2 GB/s read. Can Linus do it? I doubt it. But in my calculations, it IS possible. (The efficient ones are below 1.4W/TB usable, but I can make below 1.1W/TB usable.) Enjoy ur headache Linus.

Buy Seagate ECAP 10TB drives on Amazon: http://geni.us/QQ8BG6d Learn more about the 45Drives Storinator: http://geni.us/6x4qLo We got a PETABYTE worth of drives from Seagate and some badass enclosures from 45Drives... let's get 'em installed.

http://engt.co/2uBw54H Intel has announced a new form factor SSD with a petabyte capacity that they're calling the "ruler." It fits in a server rack, and is said to be coming with both Optane and 3D NAND options "in the near future." That's freaking nuts! It makes me want to get a server rack at home to make a multi-petabyte storage server just for fun lol. I'd imagine they aren't cheap though.

A guy stored nearly 2PB of porn in his "unlimited" amazon cloud! Found here: https://motherboard.vice.com/en_us/article/a33j5a/a-redditor-archived-nearly-2-million-gigabytes-of-porn-to-test-amazons-unlimited-cloud-storage Not even the LMG server can handle this...

Here's a video of a replicated cluster using (4) Storinator XL60s built using GlusterFS and ZFS. The purpose of the test is to show off the resiliency of GlusterFS and ZFS. By starting a file transfer from the cluster to a client, trying to bring the transfer down by unplugging network cables, unplugging drives and shutting down servers. There's also a blog expanding on how to create these replicated clusters.

That didn't take long - A whole Petabyte of storage is now completely full, so come along for the ride while we deploy a band-aid solution! Buy Seagate IronWolf Pro hard drives: On Amazon: https://geni.us/PSstrc On Newegg: https://lmg.gg/8KVmr

Petabyte Project successor should be called Exabyte Endeavor. CHANGE MY MIND.

MS Flight Simulator 2020 takes up over 2 Petabytes for all the geographical data and whatnot, which is why the game uses streaming. Maybe Linus could make the next Petabyte project just for FS2020. This post is kind of a joke but the it's one of those so bad it's good ideas. https://www.reddit.com/r/flightsim/comments/bzrwyy/microsoft_flight_simulator_2020_features_two/

I am sure you have all seen the recent Intel SSD news, 32TB Ruler SSD's. That right there got me thinking about Petabyte Project, as with these ruler SSD's you can have a 32 slot machine to easily make a petabyte system (not including the RAID configuration, purely RAW), and would be much quicker for the type of workflow that LTT has shown off over the years. Oh, did I not mention that these 32 slot machines are 1U? Yeah, think about the storage per litre of that bad boy. Though it might be costly (honestly, corporate accounting from Linus Media Group must still be kicking themselves from the RED situation), future proofing would be easily done. My current system for a NAS is 72 Samsung SSD 860 PRO 4TB's in Synology hardware but I am genuinely thinking of upgrading to a SuperStorage SSG-136R-NR32JBF or something similar from Supermicro and just slapping 32 x 32TB once they actually come out. Guys, please leave your comments and thoughts on this, also if you are reading this Linus, #linusdroptips.

What do you get when you give Linus a bunch of hard drives and an EPYC system to put them in? Petabyte Project 2, that's what. What could go wrong? Sponsored by Pulseway! Buy some Seagate NAS drives: On Amazon (PAID LINK): https://geni.us/16A3yRd On Newegg (PAID LINK): https://geni.us/J9i5eY

Does anyone here have a petabyte of storage? Or, what is the most storage space you have on any given device. I'm just curious because the most space I have for my own personal use is like, 400gb. :-/