Jump to content
Search In
  • More options...
Find results that contain...
Find results in...

A silent 4U storage server buildlog

RollinLower
 Share

Hi guys,

 

I'm running into problems with my current storage configuration. Mainly i want my drives to spin down when not in use, and i want to be able to rely in my storage to stay on while the connected plotting server goes down.

My current setup consists of a 1U Supermicro server with 3 DELL MD1200 SAS diskshelves attached. This is an awesome setup, but it's woefully inefficient and with current power prices just no longer feasible for home use sadly.

20220326_090838.thumb.jpg.9af24ac1b6013c317cac94348dd69114.jpg

 

So this has to change. I'm still keeping the 1U server, but the MD1200's have to go and make room for a 4U box with a power conscious server inside.

 

This buildlog is still in the planning phase as of now, but there's a couple things already set in stone:

- I will use a 4U 24 bay Supermicro chassis for this.

- instead of a HBA/JBOD config, the new Supermicro box will be a server aswell, running TrueNAS.

- Instead of a External SAS connection to the 1U Supermicro, i will be using atleast a 20G link between the boxes, but hopefully a 50G link using bonded 25G fiber connections.

This is ofcourse massive overkill and i'll probably only use 1% of this bandwith. But it'll be pretty awesome to setup!

 

Other than that, this is about it for now.

I know that i will be losing 12 bays, but that's part of the plan actually. i'm currenly using a lot of low capacity SAS drives, which i will be swapping out for just a few high capacity SATA drives. These will be more power efficient, live just as long and are much cheaper too! Also, i hope they'll be a lot quieter. These SAS bois make some noise when under load.

 

Expect updates as parts arrive!

 

Link to comment
Share on other sites

Link to post
Share on other sites

Parts list:

 

green = arrived

yellow = bought

red = planned

 

Supermicro SuperChassis 846BE16-R920B

Noctua NF-A8 ULN (5x)

Noctua NH-D9L

Intel Xeon E3-1230V5

Supermicro X11SSL-F

64GB ECC in 4x 16GB

NVMe cache disks

Supermicro 64GB SATADOM boot drive

Link to comment
Share on other sites

Link to post
Share on other sites

First parts are arriving!

 

First up, the brains of this operation. The CPU:

20220426_192516.thumb.jpg.c29a8359b499afe856290169f4c84943.jpg

 

I gotta say, this was kind of a shock for me. I've been working with Xeon scalable and AMD EPYC chips for so long now that i have actually forgotten how small a 'normal' Intel chip can be. This things is really tiny!

20220426_192815.thumb.jpg.acb6d926971637e8b0fad9c8c7d5cc76.jpg

 

next up: The boot drive. A 64GB SATA disk on module. small, no cables and mucho cheap!

20220426_192545.thumb.jpg.414ccdddbee99ca94c2f715be9af501f.jpg

 

Also the RAM arrived:

20220426_192612.thumb.jpg.39f041388bde6ee20850d235c09a53a3.jpg

 

Nothing special about this to be honest, just 4 sticks of DDR4 UDIMM. Honestly one of these would be plenty for what i'm planning to do, but i guess a little overkill can't hurt. 😉

 

i also got word that the motherboard, case and cooler should be here by thursday, which means i can get this thing installed thursday night if everything goes well! That's really awesome. this project is progressing way faster than i initially expected.

 

Updates as parts arrive!

Link to comment
Share on other sites

Link to post
Share on other sites

Sadly no case or motherboard yet, delivery was postpoined untill tomorrow. But i did get the CPU cooler today.

Nothing too fancy, just a simple Noctua tower that should be small enough to fit inside the 4U case, and also powerfull enough to cool the Xeon with the fan barely spinning.

cooler.thumb.jpg.3df4680238505c3a4326acf6fe7c9744.jpg

 

Also also, Noctua ships metal case badges with their coolers. Now normally i wouldn't care at all, i never really put any badges on my systems. But this time i decided to stick it onto my distributed computing server. And well, i think it's gonna stay there for a while. It looks pretty nice!

badge.thumb.jpg.74cf25648f0c4c5670d177c6ff3b435b.jpg

 

Expect more substantial updates tomorrow when the case and motherboard arrive!

Link to comment
Share on other sites

Link to post
Share on other sites

Welp, sadly no motherboard today... 

But i did get that case!

 

This thing is an absolute unit!

20220429_161415.thumb.jpg.9008f8a233591097b5511588a0d89368.jpg

 

I bought this thing as just an empty chassis with PSU's, but to my surprise it also had a motherboard and HBA inside.

20220429_161411.thumb.jpg.5a59e969cbfd83d8be2b111e233b49a7.jpg

 

This motherboard is almost the exact model i'm gonna use, just a few generations older. It works out perfectly to plan out the build further!

The included HBA only had 1 SAS connection though, and i want to be able to hook up another JBOD when i run out of bays with this thing. So i swapped it out for an LSI 9201-16i. This thing has 4 ports, and i hooked two of them up to an adapter that adapts them to external SFF8088 ports.

20220429_161122.thumb.jpg.e7f201a63019cb6c03dbff2ad544ef4d.jpg

 

Add another 10G NIC and into the rack she goes!

20220429_170428.thumb.jpg.c3848fcf4f36473f4a2a007cf54c4a17.jpg

 

now ofcourse this thing is a lot longer than the MD1200's i was running before. The MD1200 chassis where so short depth that even in my audio-grade rack, they got to about 2/3rds of the length. This box though, is so long that it sticks out about 10cm from the back of the rack!

20220429_165918.thumb.jpg.ea82e9e007b83002069df53db6de5b13.jpg

 

Not the end of the world, but i have to be carefull rolling this thing around now, especially when i get the fibers hooked up. There's a real good chance i crush a fiber betwen the rack and the wall if i roll it back into position now.

 

Anyway, that's it for now again, i did recieve word that the actual motherboard i will be using should arrive tomorrow between 10AM to 1PM, so i should have plenty of time to build this thing and get TreuNAS going. I am also definitely going to be swapping out the case fans for something a little more quiet. Right now this thing is a proper jet enigne when booting up. 

 

Also, you might have noticed that because this thing is only 4U tall instead of the 6U the 3 MD1200's took up, i have space for a bit more storage underneath it! Definitely nice to be able to have more place to put things, my apartment was starting to get filled up with computer parts all over, now i have a dedicated drawer for my spare hardware.

 

Expect updates as the final parts come in!

Link to comment
Share on other sites

Link to post
Share on other sites

Great update !

Question: How quiet is the whole thing ? Once you install silent fans for the new 4U server.

I saw that you even changed a PSU fan for a Noctua one.

Link to comment
Share on other sites

Link to post
Share on other sites

28 minutes ago, Anthony_95 said:

Great update !

Question: How quiet is the whole thing ? Once you install silent fans for the new 4U server.

I saw that you even changed a PSU fan for a Noctua one.

Oh yeah, i really like my systems to be quiet! All servers in my rack are watercooled and literally all fans are noctuas, even the PSU fans in all my machines. Even in the network switch up top i swapped all fans out for 40mm noctua's. This is going to be the first aircooled box i build in years 😅

 

I specifically wanted this chassis because it has support for these PSU's:

20220429_202637.thumb.jpg.d4981e3264c5ba2892f15ee122956b30.jpg

 

These are 920 watts each, which is nice because the massive overkill means they'll never have to work hard. That in turn is great for silence, but the real gamechanger is the SQ on the end of the model number. That stands for Super Quiet. These PSU's are literally inaudible when in use! No noctua fanmod required.

20220429_202646.thumb.jpg.baf78ca500eda5d783264370b8f0796e.jpg

 

Right now the casefans are still very loud though, but i have 5x Noctua NF-A8 ULN on the way to replace those, and after that i expect the loudest parts in this build to be the harddrives themselves. 😉

Link to comment
Share on other sites

Link to post
Share on other sites

On 4/26/2022 at 7:34 PM, RollinLower said:

next up: The boot drive. A 64GB SATA disk on module. small, no cables and mucho cheap!

This thing is genius. How have I never encountered it. Not getting server hardware I guess, but still.

Crystal: CPU: i7 7700K | Motherboard: Asus ROG Strix Z270F | RAM: GSkill 16 GB@3200MHz | GPU: Nvidia GTX 1080 Ti FE | Case: Corsair Crystal 570X (black) | PSU: EVGA Supernova G2 1000W | Monitor: Asus VG248QE 24"

Laptop: Dell XPS 13 9370 | CPU: i5 10510U | RAM: 16 GB

Server: CPU: i5 4690k | RAM: 16 GB | Case: Corsair Graphite 760T White | Storage: 19 TB

Link to comment
Share on other sites

Link to post
Share on other sites

21 minutes ago, tikker said:

This thing is genius. How have I never encountered it. Not getting server hardware I guess, but still.

jup, these things are everywhere in the server world. Not very common to seem them in other systems though, since sometimes you need a special SATA port on your motherboard to run them. Also, if you run a OS like TrueNAS they should be perfect for what you do, but if you run a more common OS like Ubuntu you might want to look elsewhere, because endurance on these is pretty weak. I work in datacenters around Amsterdam and i'm swapping these out all the time in our hypervisors.

Link to comment
Share on other sites

Link to post
Share on other sites

8 hours ago, RollinLower said:

jup, these things are everywhere in the server world. Not very common to seem them in other systems though, since sometimes you need a special SATA port on your motherboard to run them. Also, if you run a OS like TrueNAS they should be perfect for what you do, but if you run a more common OS like Ubuntu you might want to look elsewhere, because endurance on these is pretty weak. I work in datacenters around Amsterdam and i'm swapping these out all the time in our hypervisors.

Oh a fellow Dutchie. Working at/with SURF by any chance? The special port thing was indeed something I was wondering about and too bad that they don't live long.

 

The rest is looking pretty slick. I'm looking forward to swap out my old gaming PC and random switches for a proper rack setup once I have some time and money for it.

Crystal: CPU: i7 7700K | Motherboard: Asus ROG Strix Z270F | RAM: GSkill 16 GB@3200MHz | GPU: Nvidia GTX 1080 Ti FE | Case: Corsair Crystal 570X (black) | PSU: EVGA Supernova G2 1000W | Monitor: Asus VG248QE 24"

Laptop: Dell XPS 13 9370 | CPU: i5 10510U | RAM: 16 GB

Server: CPU: i5 4690k | RAM: 16 GB | Case: Corsair Graphite 760T White | Storage: 19 TB

Link to comment
Share on other sites

Link to post
Share on other sites

10 hours ago, tikker said:

Oh a fellow Dutchie. Working at/with SURF by any chance? The special port thing was indeed something I was wondering about and too bad that they don't live long.

 

The rest is looking pretty slick. I'm looking forward to swap out my old gaming PC and random switches for a proper rack setup once I have some time and money for it.

nope, not SURF. I'm not gonna disclose my employer on here for reasons, but we have hardware in multiple Equinix, Sentia and NikHef locations around Amsterdam, and other locations like Haarlem, Miami, Tokyo, Barcelona and Valencia.

 

Word of caution: the more you invest in this stuff the more you want to keep investing. My setup is the very definition of a moneypit. But i guess that's the same with any hobby.

Link to comment
Share on other sites

Link to post
Share on other sites

She runs!

 

...Sort of. I'll explain:

 

To prepare for the new motherboard i did some light cable management.

cables.thumb.jpg.e7bc8ea37a36ed2f1c6851d32b1df0e7.jpg

 

Mainly i pre-routed the cables to where i need them and i also spliced together all the fan headers for the hotswap fan trays. I'll be re-using these with the Noctua's, and since they just use regular old PWM this should be very easy to setup. I can keep the hotswap functionality this way which i think is pretty cool.

fan.thumb.jpg.15e0c8de72cbe883db0e45b88e9f8a9c.jpg

 

In goes the new board!

 

476195860_allaboard.thumb.jpg.7b38296172de00a48f5082c43c920b53.jpg

 

And just like that, everything is together. I did run into a slight issue where TreuNAS didn't recognise the HDD's from the backplane, but it turns out i just didn;t plug in the SAS cable all the way. That took the better part of an hour to figure out...

 

cable management out back is still not the way i want it to be, but lets just call it 'functional' for now.

 

backside.thumb.jpg.7cfc958c29f176a88bc34d62200bbe93.jpg

 

I also still have to setup bonding on the 2x 10G link. right now the systems treat it like 2 seperate connections, and that's better for redundancy ofcourse, but i want speed! So that's still on the to do list.

 

done!.thumb.jpg.cff108f4933010797acdfd1769f6d911.jpg

 

So what's the problem then? Well, the casefans are delayed in transit. I don't know when they'll arrive, but probably sometime mid next week. So untill then, this box is going to have to run entirely with just the single fan from the CPU cooler. So untill then, i'm gonna have this box turned off. It's ready and TrueNAS is installed and working, but i don't want to risk overheating the HBA or the drives. 

 

I'll cover the software side of things in the next post. 🙂

Link to comment
Share on other sites

Link to post
Share on other sites

On 4/29/2022 at 1:46 PM, RollinLower said:

I bought this thing as just an empty chassis with PSU's, but to my surprise it also had a motherboard and HBA inside.

...

This motherboard is almost the exact model i'm gonna use, just a few generations older. It works out perfectly to plan out the build further!

That X9SCL is the same motherboard I've been running in my Free/TrueNAS for years. I originally was running an i3-2100 Sandy Bridge in it whose IMC fully supports ECC but upgraded it to an e3-1240v2 recently. So if you have plans for off-site replication for critical data it could make a nice platform to start with.

I just wish they'd do away with their OOB licensing requirements and allow firmware updates natively through the BMC.

FaH BOINC HfM

Bifrost - 6 GPU Folding Rig  Linux Folding HOWTO Folding Remote Access Folding GPU Profiling

Systems:

desktop: Lian-Li O11 Air Mini; Gigabyte Aorus ax570 Master; Ryzen 9 5900x;Noctua NH-D15; 4 x 16GB DDR4-3200; 500GB PCIe3 NVMe; 4 x 3TB NAS; AMD RadeonPro W4100; EVGA RTX 2070A; Corsair TX650M

nas1: Fractal Define R4; SuperMicro X10sl7-f; Xeon e3-1231v3; 4 x 8GB DDR3-1666 ECC; 6 x 3TB NAS; 6 x 4TB NAS

nas2: Synology DS-123j; 2 x 6TB NAS

dcn01: Fractal Meshify C; Gigabyte Aorus ax570 Master; Ryzen 9 5950x; EVGA 240 CLC; 2 x 32GB DDR4-3200; 512GB NVMe; EVGA RTX 2070 Super XC Hybrid; Corsair TX650M

dcn02: Fractal Define S; Gigabyte ax570 Pro WiFi; Ryzen 9 3950x; Noctua NH-D15; 2 x 16GB DDR4-3200; 128GB NVMe; EVGA RTX 2070 Super XC Hybrid; EVGA RTX 2060 XC Ultra Gaming; Corsair RM750x

dcn03: Fractal Meshify S2; Gigabyte Aorus ax570 Pro WiFi; Ryzen 9 5900x; Noctua NH-U12S; 2 x 16GB DDR4-3200; 128GB NVMe; EVGA RTX 2070 Super XC Hybrid; EVGA RTX 2060 Super XC Gaming; Corsair RM750

dcn04: Fractal Meshify S2; Gigabyte x370 Gaming K7; Ryzen 9 3900x; Noctua NH-U12S; 4 x 16GB DDR4-3200; 128GB NVMe; EVGA RTX 2070 Super XC Hybrid; Asus TUF RTX3070 ti; Corsair TX750M

dcn05: Fractal Define R4; Gigabyte ax370 Gaming K7; i9-9900K; EVGA 280 CLC; 2 x 8GB DDR4-3200; 128GB NVMe; EVGA RTX 2070 Super XC Hybrid; EVGA GTX 1660ti XC Ultra Gaming; Corsair TX650M

dcn10: Fractal Define C; Gigabyte b450 Aorus M; Ryzen 9 5900x; Ryzen 7 2700x; Hyper 212Evo e/w Noctua NF-A12; 2 x 8GB DDR4-3200; Samsung 250GB SSD; EVGA XC GTX 1070 ti 8GB; Corsair TX550M

dcn11: Fractal Focus G mini; Gigabyte b450 Aorus M; Aorus M; Ryzen 7 2700; Wraith Spire; 2 x 8GB DDR4-3200; Samsung 840 Pro 128GB SSD; ATI Radeon HD2400 Pro; Corsair CX450M Bronze

dcn12: Fractal Core 1100; Gigabyte b450 Aorus M; Ryzen 7 2700; Wraith Spire; 2 x 8GB DDR4-3200; Samsung EVO 850 128GB SSD; ATI FirePro 2270; Corsair CX500M Bronze

dcn19: SuperMicro SC731; SuperMicro X9scl; Xeon e3-1240v2; 4 x 4GB DDR3-1333 ECC; 120GB SSD; SuperMicro 300W Bronze

Link to comment
Share on other sites

Link to post
Share on other sites

On 4/30/2022 at 8:02 AM, RollinLower said:

jup, these things are everywhere in the server world. Not very common to seem them in other systems though, since sometimes you need a special SATA port on your motherboard to run them. Also, if you run a OS like TrueNAS they should be perfect for what you do, but if you run a more common OS like Ubuntu you might want to look elsewhere, because endurance on these is pretty weak. I work in datacenters around Amsterdam and i'm swapping these out all the time in our hypervisors.

The endurance of these Disk on Modules (DoMs) will be much better than the USB Thumb Drives usually used in TrueNAS builds but as you mention they'll be fine in TrueNAS as they're only read on boot the the OS goes into RAM. I used a pair (mirror) of 4GB USB thumb drives and since 2015 only had one failure.

FaH BOINC HfM

Bifrost - 6 GPU Folding Rig  Linux Folding HOWTO Folding Remote Access Folding GPU Profiling

Systems:

desktop: Lian-Li O11 Air Mini; Gigabyte Aorus ax570 Master; Ryzen 9 5900x;Noctua NH-D15; 4 x 16GB DDR4-3200; 500GB PCIe3 NVMe; 4 x 3TB NAS; AMD RadeonPro W4100; EVGA RTX 2070A; Corsair TX650M

nas1: Fractal Define R4; SuperMicro X10sl7-f; Xeon e3-1231v3; 4 x 8GB DDR3-1666 ECC; 6 x 3TB NAS; 6 x 4TB NAS

nas2: Synology DS-123j; 2 x 6TB NAS

dcn01: Fractal Meshify C; Gigabyte Aorus ax570 Master; Ryzen 9 5950x; EVGA 240 CLC; 2 x 32GB DDR4-3200; 512GB NVMe; EVGA RTX 2070 Super XC Hybrid; Corsair TX650M

dcn02: Fractal Define S; Gigabyte ax570 Pro WiFi; Ryzen 9 3950x; Noctua NH-D15; 2 x 16GB DDR4-3200; 128GB NVMe; EVGA RTX 2070 Super XC Hybrid; EVGA RTX 2060 XC Ultra Gaming; Corsair RM750x

dcn03: Fractal Meshify S2; Gigabyte Aorus ax570 Pro WiFi; Ryzen 9 5900x; Noctua NH-U12S; 2 x 16GB DDR4-3200; 128GB NVMe; EVGA RTX 2070 Super XC Hybrid; EVGA RTX 2060 Super XC Gaming; Corsair RM750

dcn04: Fractal Meshify S2; Gigabyte x370 Gaming K7; Ryzen 9 3900x; Noctua NH-U12S; 4 x 16GB DDR4-3200; 128GB NVMe; EVGA RTX 2070 Super XC Hybrid; Asus TUF RTX3070 ti; Corsair TX750M

dcn05: Fractal Define R4; Gigabyte ax370 Gaming K7; i9-9900K; EVGA 280 CLC; 2 x 8GB DDR4-3200; 128GB NVMe; EVGA RTX 2070 Super XC Hybrid; EVGA GTX 1660ti XC Ultra Gaming; Corsair TX650M

dcn10: Fractal Define C; Gigabyte b450 Aorus M; Ryzen 9 5900x; Ryzen 7 2700x; Hyper 212Evo e/w Noctua NF-A12; 2 x 8GB DDR4-3200; Samsung 250GB SSD; EVGA XC GTX 1070 ti 8GB; Corsair TX550M

dcn11: Fractal Focus G mini; Gigabyte b450 Aorus M; Aorus M; Ryzen 7 2700; Wraith Spire; 2 x 8GB DDR4-3200; Samsung 840 Pro 128GB SSD; ATI Radeon HD2400 Pro; Corsair CX450M Bronze

dcn12: Fractal Core 1100; Gigabyte b450 Aorus M; Ryzen 7 2700; Wraith Spire; 2 x 8GB DDR4-3200; Samsung EVO 850 128GB SSD; ATI FirePro 2270; Corsair CX500M Bronze

dcn19: SuperMicro SC731; SuperMicro X9scl; Xeon e3-1240v2; 4 x 4GB DDR3-1333 ECC; 120GB SSD; SuperMicro 300W Bronze

Link to comment
Share on other sites

Link to post
Share on other sites

Think long and hard about enabling compression. You can do it globally (I think that's the default) or on per pool basis. Generally there is no performance impact but for video files little benefit. I generally have it enabled for everything but disabled for my "media" pool which has all my video, audio and images.

 

De-duplication can also be useful if your planning on using this as a iSCSI target for vMs and hosting the same iso across multiple vMs but there is a performance penalty and you pretty much want a Data Center grade SSD for holding the indices.

 

Avoid WD Red drives due to Shingled Magnetic Recording (SMR) but the Red Plus & Pros are CMR. I haven't tried them but many rave about the Toshiba NAS disks. Back in the day the Hitachi disks were the Gold Standard for SATA NAS but once WD bought them out they've disappeared.

FaH BOINC HfM

Bifrost - 6 GPU Folding Rig  Linux Folding HOWTO Folding Remote Access Folding GPU Profiling

Systems:

desktop: Lian-Li O11 Air Mini; Gigabyte Aorus ax570 Master; Ryzen 9 5900x;Noctua NH-D15; 4 x 16GB DDR4-3200; 500GB PCIe3 NVMe; 4 x 3TB NAS; AMD RadeonPro W4100; EVGA RTX 2070A; Corsair TX650M

nas1: Fractal Define R4; SuperMicro X10sl7-f; Xeon e3-1231v3; 4 x 8GB DDR3-1666 ECC; 6 x 3TB NAS; 6 x 4TB NAS

nas2: Synology DS-123j; 2 x 6TB NAS

dcn01: Fractal Meshify C; Gigabyte Aorus ax570 Master; Ryzen 9 5950x; EVGA 240 CLC; 2 x 32GB DDR4-3200; 512GB NVMe; EVGA RTX 2070 Super XC Hybrid; Corsair TX650M

dcn02: Fractal Define S; Gigabyte ax570 Pro WiFi; Ryzen 9 3950x; Noctua NH-D15; 2 x 16GB DDR4-3200; 128GB NVMe; EVGA RTX 2070 Super XC Hybrid; EVGA RTX 2060 XC Ultra Gaming; Corsair RM750x

dcn03: Fractal Meshify S2; Gigabyte Aorus ax570 Pro WiFi; Ryzen 9 5900x; Noctua NH-U12S; 2 x 16GB DDR4-3200; 128GB NVMe; EVGA RTX 2070 Super XC Hybrid; EVGA RTX 2060 Super XC Gaming; Corsair RM750

dcn04: Fractal Meshify S2; Gigabyte x370 Gaming K7; Ryzen 9 3900x; Noctua NH-U12S; 4 x 16GB DDR4-3200; 128GB NVMe; EVGA RTX 2070 Super XC Hybrid; Asus TUF RTX3070 ti; Corsair TX750M

dcn05: Fractal Define R4; Gigabyte ax370 Gaming K7; i9-9900K; EVGA 280 CLC; 2 x 8GB DDR4-3200; 128GB NVMe; EVGA RTX 2070 Super XC Hybrid; EVGA GTX 1660ti XC Ultra Gaming; Corsair TX650M

dcn10: Fractal Define C; Gigabyte b450 Aorus M; Ryzen 9 5900x; Ryzen 7 2700x; Hyper 212Evo e/w Noctua NF-A12; 2 x 8GB DDR4-3200; Samsung 250GB SSD; EVGA XC GTX 1070 ti 8GB; Corsair TX550M

dcn11: Fractal Focus G mini; Gigabyte b450 Aorus M; Aorus M; Ryzen 7 2700; Wraith Spire; 2 x 8GB DDR4-3200; Samsung 840 Pro 128GB SSD; ATI Radeon HD2400 Pro; Corsair CX450M Bronze

dcn12: Fractal Core 1100; Gigabyte b450 Aorus M; Ryzen 7 2700; Wraith Spire; 2 x 8GB DDR4-3200; Samsung EVO 850 128GB SSD; ATI FirePro 2270; Corsair CX500M Bronze

dcn19: SuperMicro SC731; SuperMicro X9scl; Xeon e3-1240v2; 4 x 4GB DDR3-1333 ECC; 120GB SSD; SuperMicro 300W Bronze

Link to comment
Share on other sites

Link to post
Share on other sites

1 hour ago, Gorgon said:

I just wish they'd do away with their OOB licensing requirements and allow firmware updates natively through the BMC.

Yeah it's super frustrating to have the tools so close, yet so far behind licensing fees. It would make life so much easier!

Not to mention on older SM boards BIOS or IPMI firmware updates are a massive pain in the butt. Last time i tried it was on a X10SRI-f which i needed to update to support a newer Xeon. I must have followed 10 youtube tutorials before something actually worked. I tend to just avoid them now, if it works, it works! 😬

 

1 hour ago, Gorgon said:

Think long and hard about enabling compression. You can do it globally (I think that's the default) or on per pool basis. Generally there is no performance impact but for video files little benefit. I generally have it enabled for everything but disabled for my "media" pool which has all my video, audio and images.

 

De-duplication can also be useful if your planning on using this as a iSCSI target for vMs and hosting the same iso across multiple vMs but there is a performance penalty and you pretty much want a Data Center grade SSD for holding the indices.

 

Avoid WD Red drives due to Shingled Magnetic Recording (SMR) but the Red Plus & Pros are CMR. I haven't tried them but many rave about the Toshiba NAS disks. Back in the day the Hitachi disks were the Gold Standard for SATA NAS but once WD bought them out they've disappeared.

This is interesting. i'll be re-using a couple 14TB Seagate Exos SAS drives from my previous storage solution, but i want to create different pools with different purposes. You're right compression was on by default, and i left it the way it is for now. Getting everything up and running was step 1, dailing everything in with specific tweaks will probably be steps 2 to 1000.

 

Link to comment
Share on other sites

Link to post
Share on other sites

53 minutes ago, RollinLower said:

...  You're right compression was on by default, and i left it the way it is for now. Getting everything up and running was step 1, dailing everything in with specific tweaks will probably be steps 2 to 1000.

De-duplication, if desired, needs to be enabled at the start. Otherwise it will only de-duplicate files added after it's enabled or you have to backup, delete, enable de-duplication, then restore.

FaH BOINC HfM

Bifrost - 6 GPU Folding Rig  Linux Folding HOWTO Folding Remote Access Folding GPU Profiling

Systems:

desktop: Lian-Li O11 Air Mini; Gigabyte Aorus ax570 Master; Ryzen 9 5900x;Noctua NH-D15; 4 x 16GB DDR4-3200; 500GB PCIe3 NVMe; 4 x 3TB NAS; AMD RadeonPro W4100; EVGA RTX 2070A; Corsair TX650M

nas1: Fractal Define R4; SuperMicro X10sl7-f; Xeon e3-1231v3; 4 x 8GB DDR3-1666 ECC; 6 x 3TB NAS; 6 x 4TB NAS

nas2: Synology DS-123j; 2 x 6TB NAS

dcn01: Fractal Meshify C; Gigabyte Aorus ax570 Master; Ryzen 9 5950x; EVGA 240 CLC; 2 x 32GB DDR4-3200; 512GB NVMe; EVGA RTX 2070 Super XC Hybrid; Corsair TX650M

dcn02: Fractal Define S; Gigabyte ax570 Pro WiFi; Ryzen 9 3950x; Noctua NH-D15; 2 x 16GB DDR4-3200; 128GB NVMe; EVGA RTX 2070 Super XC Hybrid; EVGA RTX 2060 XC Ultra Gaming; Corsair RM750x

dcn03: Fractal Meshify S2; Gigabyte Aorus ax570 Pro WiFi; Ryzen 9 5900x; Noctua NH-U12S; 2 x 16GB DDR4-3200; 128GB NVMe; EVGA RTX 2070 Super XC Hybrid; EVGA RTX 2060 Super XC Gaming; Corsair RM750

dcn04: Fractal Meshify S2; Gigabyte x370 Gaming K7; Ryzen 9 3900x; Noctua NH-U12S; 4 x 16GB DDR4-3200; 128GB NVMe; EVGA RTX 2070 Super XC Hybrid; Asus TUF RTX3070 ti; Corsair TX750M

dcn05: Fractal Define R4; Gigabyte ax370 Gaming K7; i9-9900K; EVGA 280 CLC; 2 x 8GB DDR4-3200; 128GB NVMe; EVGA RTX 2070 Super XC Hybrid; EVGA GTX 1660ti XC Ultra Gaming; Corsair TX650M

dcn10: Fractal Define C; Gigabyte b450 Aorus M; Ryzen 9 5900x; Ryzen 7 2700x; Hyper 212Evo e/w Noctua NF-A12; 2 x 8GB DDR4-3200; Samsung 250GB SSD; EVGA XC GTX 1070 ti 8GB; Corsair TX550M

dcn11: Fractal Focus G mini; Gigabyte b450 Aorus M; Aorus M; Ryzen 7 2700; Wraith Spire; 2 x 8GB DDR4-3200; Samsung 840 Pro 128GB SSD; ATI Radeon HD2400 Pro; Corsair CX450M Bronze

dcn12: Fractal Core 1100; Gigabyte b450 Aorus M; Ryzen 7 2700; Wraith Spire; 2 x 8GB DDR4-3200; Samsung EVO 850 128GB SSD; ATI FirePro 2270; Corsair CX500M Bronze

dcn19: SuperMicro SC731; SuperMicro X9scl; Xeon e3-1240v2; 4 x 4GB DDR3-1333 ECC; 120GB SSD; SuperMicro 300W Bronze

Link to comment
Share on other sites

Link to post
Share on other sites

Just a quick update: i got the fans and installed them. Disks seem happy i did too!

disks.thumb.JPG.ffbf7fc5d8792627eed1ae252a6f5a9f.JPG

 

Currently writing up the software post, but i'ts a lot harder to explain things when you only understand 50% of what's happening yourself...

Link to comment
Share on other sites

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
 Share


×