Mass Data Storage Help

[DailyProcrastinator]

LTT'ers I need help! I am a complete noob when it comes to anything related to mass storage (outside of using 4 & 8-bay external enclosures and basic RAID configs) and my use case for mass storage IS GREATLY increasing at a rapid rate. 

 

I am currently weighing options and it seems that for my use case a JBOD DAS will work. But this is not totally clear to me and if require to switch to a better solution I can do so. I really just need to figure out what direction I need to execute on.

I found these that set me on that path:

https://www.servethehome.com/sas-expanders-diy-cheap-low-cost-jbod-enclosures-raid/

https://forums.serverbuilds.net/t/guide-direct-attached-storage-das-add-up-to-16-3-5-drive-bays-to-an-existing-server-for-less-than-300/136

 

My workflow is as follows:

I am writing data to 3.5" HDDs (4TB-12TB capacities) in a 2-bay hot-swap dock, 4TB per day, on 3 different systems (12TB total). And once the writing process is complete I do not need to read or write from that disk, but I do need to see it and have it connected to a single system, I do not need network storage of any kind. Which is what leads me to think that a JBOD DAS is the best bet? And I can connect to one of my systems via an HBA? 

 

In the near future I will look to redundancy and higher capacity drives. However, my short-term (2-3 month) focus is just getting the best value in terms of $/TB and getting as many drives connect as possible for as cheap, but effective and safe, as possible. This is new to me but my workflow just drastically changed and I am trying to learn and implement as fast as possible. But between juggling this and other areas of growth, I am a bit lost on the data storage side.

 

For my use case I require the following:

1. 15-bay enclosure at a minimum, 4U is fine, Ideally under 650mm long 

2. Power of scaling, is there an effective way to daisy chain? IE if I add 3x more 15-bay solutions is there a possibility to daisy chain them together? 

3. If I go DAS and connect via HBA, how does this limit my PCIe lane usage on a system. And would connecting it to a B450i/R3 2200G or Z490/i7-10700k work? Or is the only solution a prosumer platform? 

 

For more info required that could help please let me know. Like I said, I am lost in the sauce on this one, and need guidance.

 

Thanks (a ton) in advance!

 

[Electronics Wizardy]

8 minutes ago, DailyProcrastinator said:

Which is what leads me to think that a JBOD DAS is the best bet?

Yup that seems like the best way to connect lots of drives to a single system

 

9 minutes ago, DailyProcrastinator said:

And I can connect to one of my systems via an HBA? 

Yup, noramlly one system is easy, and you need a correct hba to use

 

9 minutes ago, DailyProcrastinator said:

2. Power of scaling, is there an effective way to daisy chain? IE if I add 3x more 15-bay solutions is there a possibility to daisy chain them together? 

server DAS are almost all SAS, so you can daisy chain them easily. Each hba normally supports like 128 or 256 drives max

 

9 minutes ago, DailyProcrastinator said:

3. If I go DAS and connect via HBA, how does this limit my PCIe lane usage on a system. And would connecting it to a B450i/R3 2200G or Z490/i7-10700k work? Or is the only solution a prosumer platform? 

This really depends on the board and how it uses the lanes, but normally there is a x4 slot from the chipset that should be fine here(hdds are slow, you don't need a ton of speed). A am4/1200 board with a extra pcie slot will work fine.

 

10 minutes ago, DailyProcrastinator said:

1. 15-bay enclosure at a minimum, 4U is fine, Ideally under 650mm long 

Id hunt for something like a sa120 or simmar SAS jbods. Often pretty cheap, supports lots of drives(normally 12 per 2u without back loading or top loading or 2 drives a tray. 

 

Also think about power. Those drives can use 5-10w each, so it adds up fast.

 

Also how much does noise matter, those das units often are loud, and not something Id want to be in the same room as.

[DailyProcrastinator]

First of all, THANK YOU!

 

16 minutes ago, Electronics Wizardy said:

Yup that seems like the best way to connect lots of drives to a single system

Glad to know I haven't totally wasted the last 36hrs!

 

17 minutes ago, Electronics Wizardy said:

Yup, noramlly one system is easy, and you need a correct hba to use

Great! Any recommendations? And what cables I require SFF-xxxx?

 

17 minutes ago, Electronics Wizardy said:

server DAS are almost all SAS, so you can daisy chain them easily. Each hba normally supports like 128 or 256 drives max

That's kind of what I was seeing as well, but as I did not specifically require a SAS (my assumption), good to know this info.

 

20 minutes ago, Electronics Wizardy said:

This really depends on the board and how it uses the lanes, but normally there is a x4 slot from the chipset that should be fine here(hdds are slow, you don't need a ton of speed). A am4/1200 board with a extra pcie slot will work fine.

Yeah I have empty PCIe 16x slots on both my Asus Z490-A Prime, and Asus B450i, with the PCIe lanes to spare. My X470 is capped out with no lanes to spare.

 

23 minutes ago, Electronics Wizardy said:

Id hunt for something like a sa120 or simmar SAS jbods. Often pretty cheap, supports lots of drives(normally 12 per 2u without back loading or top loading or 2 drives a tray. 

This is the direction I need, thank you! There are so many options and every time I look I just get more confused as I do not know what it is I exactly need. 

 

23 minutes ago, Electronics Wizardy said:

Also think about power. Those drives can use 5-10w each, so it adds up fast.

I will run a PSU in each rack (550-650w), basic ATX for now and will go redundant PSU in the near future, Also have an external UPS.

 

25 minutes ago, Electronics Wizardy said:

Also how much does noise matter, those das units often are loud, and not something Id want to be in the same room as.

They will be in their own room, and possibly offsite in the future, good to know they can be noisy, now this should not be an issue.

 

 

[Electronics Wizardy]

2 hours ago, DailyProcrastinator said:

Great! Any recommendations? And what cables I require SFF-xxxx?

This depends on the unit you get, normally sff8087 for older sas boxes.

 

2 hours ago, DailyProcrastinator said:

Yeah I have empty PCIe 16x slots on both my Asus Z490-A Prime, and Asus B450i, with the PCIe lanes to spare. My X470 is capped out with no lanes to spare.

 

Yea if you have a extra pcie slot it will work fine

 

2 hours ago, DailyProcrastinator said:

That's kind of what I was seeing as well, but as I did not specifically require a SAS (my assumption), good to know this info.

 

MOst of them will let you daiy chain them, so plug one sas cable on the das to your pc, and the other connector to anouther das

 

2 hours ago, DailyProcrastinator said:

I will run a PSU in each rack (550-650w), basic ATX for now and will go redundant PSU in the near future, Also have an external UPS.

 

Those das units normally have a built in psu, so you can just run ac power to them. If you fill a full rack make sure the breaker can handle it

 

Look into das models like a sa120, or simmilar. Here is a net app ds4246. Pretty cheap and supports 24 drives in 4u https://www.ebay.com/itm/NetApp-DS4246-Disk-Array-Shelf-W-24x-SAS-SATA-Trays-2x-IOM6-Expansion-Array/202404952486?epid=17031090392&hash=item2f204679a6:g:ZdoAAOSwhBVdSytX