LTT Storage Rankings

[Ultraforce]

On 6/30/2022 at 10:41 AM, Helly said:

Felt like posting an update. Because a whole lot has changed in my setup.

 

Hardware

CASE: Cooler Master HAF Stacker 935.
PSU: Corsair HX1200
MB: Asus ROG Zenith Extreme Alpha
CPU: AMD Ryzen Threadripper 2950x
HS: Noctua NH-U14S TR4-SP3
RAM: 128GB Kingston Fury Beast 3200Mhz

RAID CARD 1: Areca 1883ix16

Boot Drive: USB 32Gb Drive

Raid Array 1: 8x 6TB WD Red
Raid Array 2: 6x 8TB WD Red

Raid Array 3: 12x 6TB WD Red (mostly SMR unfortunately)

UnRAID array drives: 2x Kingston KC2500 1TB

UnRAID pool drives: 1x Samsung 950pro 512GB

 

PCPartpicker link (haven't edited the system yet maybe later)

 

Software and Configuration:
Running UnRAID with several dockers and VM's. A webserver (windows server 2022), ubuntu for a pi-hole (yes can do this is docker, don't feel like it) and a windows server 2019 for work. Dockers include NZBget, Redis and Vaultwarden as well as a few game servers.

Array's 1 and 2 are connected to the Areca card, both running in RAID-6. Array 3 is a Promise 1830i SAN connected through iSCSI with 3 1Gbit connections. Also in RAID-6. It has trouble reaching high speeds though and took almost 2 weeks to initialize the array . Tiny configuration error though, it should be able to do it faster.

 

Usage:

Storing my media files (movies and tv shows). currently almost 24TB in size. Files are usually copied over from my main PC over a 10Gbit connection to the server, which is a separate network between a few of my PC's. Connected through a 8 port 10Gbit switch

Backup:
LOL? Maybe on a few old drives but in no way ever up-to-date.

Sorry if this is an inappropriate place to ask but what has been your experience with UnRAID as well as is there a particular reason you use Vaultwarden instead of selfhosting BitWarden directly?

For a main computer use that would double partially as a VM/server I'm thinking UnRAID might be wise as the hypervisor and I've been exploring self hosting bitwarden and am not sure completely of all the advantages or disadvantages of using vaultwarden instead of the system that Bitwarden's website guides.

[Helly]

On 9/7/2022 at 6:44 AM, Ultraforce said:

Sorry if this is an inappropriate place to ask but what has been your experience with UnRAID as well as is there a particular reason you use Vaultwarden instead of selfhosting BitWarden directly?

For a main computer use that would double partially as a VM/server I'm thinking UnRAID might be wise as the hypervisor and I've been exploring self hosting bitwarden and am not sure completely of all the advantages or disadvantages of using vaultwarden instead of the system that Bitwarden's website guides.

I've had bitwarden running the way they explain it on the website, on my windows webserver within unraid because ports 80 and 443 are forwarded to that. But that uses Docker Compose and it made the VM slow AF. I don't know if it was the hardware (ran on my older Xeon E5 2620) or something else. It made the webserver a massive pain in the ass to work with. So i decided to try running it in a docker and put it on an alternate port. I don't use any special features of bitwarden, i just need to be able to store my passwords and be able to use them on any device. Vaultwarden is fine for that, plus its also a lot lighter on the hardware then bitwarden itself.

It was also another massive pain in the ass to get a new SSL certificate every few months when it ran on the VM. I had to turn off IIS in order to give the ports to bitwarden so it could get the certificates. Now i just generate them on the webserver and put them in the folder where vaultwarden reads them. All i need to do is restart the docker which takes literally 5 seconds instead of the minutes it took to restart bitwarden.

So for me personally vaultwarden is better in every single way possible over bitwarden itself.

 

As for unraid, there have been ups and downs but overall i'm sticking with it as it just works for me and don't have any real problems with it anymore.

[gcs8]

On 7/6/2018 at 12:26 AM, gcs8 said:

My old 2011 build still has me in 23ed place, let's see where my current build gets me. Let me know if I missed anything else you may want me to cover, this is just kinda everyday life for me, so if you wanna know more, just ask.

Hardware

768GB DDR4-2133(24x32GB) LRDIMM

Supermicro Rackmount 4U w/ Red. 1280W Platinum P/S

24x: Samsung DDR4 2133MHzCL15 32GB (PC4 2133) Internal Memory M386A4G40DM0-CPB

2x: Intel 2.20GHz Xeon E5-2630 v4 Deca-Core (10-Core), 25MB Intel Smart Cache, Socket-2011-v3 (FC-LGA14A)

24x: HGST Hard Drive [HUH728080AL5200] 8TB SAS 12Gb/s 7200RPM 3.5in, 128MB Buffer, Internal

Supermicro Motherboard S-2011 R3 for 2x E5-2600 v3 MFG Part Number: X10DRi-T4+

LSI Logic Controller Card H5-25573-00 9300-8i SGL SAS 8Port 12Gb/s PCIE3.0 HBA Brown Box

QLE2562 dual 8Gbps Fibre Channel

2x: Supermicro 4U Active CPU Heatsink f/ X9 Socket 2011 MFG Part Number: SNK-P0050AP4

2x: ASUS HYPER M.2 x16 PCIe Expansion Card

Chelsio T62100-SO-CR

Software and Configuration:

FreeNAS

Usage:

NAS and SAN usage, My desktop boots off of FiberChannel from the FreeNAS box so I can have snapshots every 5 min on my OS drive and I keep my main OS drive small enough to cache it in RAM on FreeNAS. It hosts a lot of VMs and Jails that do stuff and things, I try and keep my digital hoarding inside the rack.

 

Photo's:

 

I have done some upgrades to this setup, it is now dual E5-2673 v4's (40 core / 80 threads) and has been expanded from 24 disk to 42 disks, 312.34TiB useubial, 516TB disk total (469TiB). With this revision I also added two ZILs (INTEL SSDPEL1K200GA) and two L2ARC devices (Samsung SSD 970 EVO 2TB) along with a hot spare 18T drive. 

 

[The_Unicorn]

OK I have many servers in various states of repair.

 

The Top one in the Pic is an Edit Share with 64TB of storage and 10gb ethernet

 

The Big one is at the bottom  it is the 340TB server detailed below. The other 3 are not pictured.

 

2 Have 64TB

2 Have 108TB

 

but as I can only list one server here for points I will list the big one.

 

SERVER 1: Server is HP dl380p with 160GB Ram and Dual 6 core CPU's

 

RAID Card 1: Lenovo SAS9300 16E 12Gb/s 

 

NIC: Dual 10gbe

 

SSD: Dual 1TB NVME PCI-e card

 

HDD1: 8 x 600GB 10k SAS (boot and logs)

 

HDD2: Dell Compellant SC280 with 84 x 4TB SAS drives 336TB Raw with Mirrored 1TB Special Meta device NVME.

 

 

Software and Configuration:

My server is running TrueNAS

My main array consists of 11x7 drive RaidZ2 plus 7 x hot spares.

 

Usage:

I use the storage for Movies and TV Series, I have media players around the farm that access it.

It is also used for backing up my computers and those of my clients during data recovery. I do a bit of Video editing and training videos which take up 50TB. 

 

Backup:

The array is backed up to various other servers plus some work stations. I have a LTO6 tape array to configure selective data backups. One of my Macs has 30TB Local another has 20TB local. I would love to use cloud backup like Linus was going to do to Google Drive. BackBlaze would be $500-1000/month.

 

Additional info:

I have progressed from Unraid to an early version of TrueNAS to the current version. Suffering from some server failures along the way. I used to run a 17 x 2TB Novell box which was awesome and fast. But I found out the hard way about hardware RAID5 and 2TB drive rebuilds. So after much testing and data transfers I have settled on TrueNAS with special Metadevice.

 

I currently don't use all 336TB but plan to run photo's storage for students that will amount to many TB's. I also do video editing and training videos.

 

I am 80-90% of the way to 1PB in raw drives. But scattered over many systems. I love watching Linus go through hell with his systems so I can learn what not to do. 

 

 

Edited July 24, 2023 by The_Unicorn
Add missing Photo's

[Jarsky]

On 1/25/2020 at 3:39 PM, Jarsky said:

I should really update my storage server as well!

 

Guess I should update on my homelab again, just a few changes. 

I just replaced my NVMe's and upgraded the parity drives. 2023 will be replacing the storage drives with larger capacity drives. 

 

Hardware

• Motherboard: ASRock X570 Taichi
• CPU: AMD Ryzen 9 3950x
• Cooling: Fractal Design Celsius S36 Triple AIO, 7 x Fractal Design Silent Series 120mm fans. 
• Case: Fractal Design Define R6
• Network: Built in NIC
• GPU: EVGA GTX1070 FTW
• RAM: 64GB DDR3 (4 x 16GB DDR4-3000 Corsair Vengeance LPX)
• PSU: Corsair RM850x v2
• HBA: LSI 9211-8i (IT Mode)
• Boot drive: Kingston 32GB USB DataTraveler SE9
• Storage drives: 10 x 8TB HGST Ultrastar HE10
• Parity drives: 2 x 16TB Seagate EXOS X16 DC Drives
• Cache drives: 1 x 500GB Gigabyte Aorus 500GB NVMe Gen4 SSD
• VM Datastore drives: 2 x 2TB Samsung 970 Evo Plus NVMe Gen3 SSD

Total capacity: 116.5TB (raw), 82.5TB useable space

 

Software and Configuration:

UnRAID for array with 2 Parity Drives. NVMe's in a mirrored pool for Docker & VM's. Running Wireguard VPN, Docker running Tdarr, Databases, Monitoring, etc...

"Mediabox VM" Ubuntu 22.04.1 VM with Docker running Portainer, Plex, qBitTorrent, NZBGet, Sonarr, Radarr, Lidarr, Overseerr, Tautulli, Prowlarr, Navidrome, Notifiarr, etc...

"Jumphost VM" Ubuntu 22.04.1 VM with Docker as a Reverse Proxy for all my services, also provides me access to my network

Windows Server 2019 VM running various automation scripts i've created over time and as an RDP jumphost (via SSH tunnel) into my network for management. 

Various other VM's (ESXi, FreeNAS (iSCSi target for ESXi), Windows 7 & XP (for old software), etc.....

 

GPU is in passthrough from UnRAID to Ubuntu VM, then Docker to Plex for transcoding. 

/dev/shm (ram drive) is also passed through to VM for transcoding on the memory rather than SSD. 

 

Usage:

Media storage, Plex server, Download automation, Machine backup & VM testlab. 

 

This replaced my other 4 server machines which have been powered off.

Compute VM Servers were 2 x Dell R710 & 1 x Dell R610 w/ 2xXeon X5650, 64GB ECC DDR3 Ram & 5 x 500GB Samsung 850 EVOs each.

Storage Server was Asus Z8NA-D6C motherboard, 2 x Xeon X5650, 48GB ECC DDR3, 2 x 500GB Samsung 850 EVO's, 5 x 8TB Seagate Archives, 10 x 3TB WD Red, LSI 9271-8i Raid card w Intel RES240SV SAS expander, Corsair 400R case, Seasonic Focus Plus PSU & IcyDock hotswap bays. 

 

Backup:

VM's are backed up weekly to the storage array. 

No backup for the array

 

 

I Also run 2 x Raspberry Pi 4B+ 8GB's.

These are for running my DNS services & Ubiquiti UniFi Controller

 

Both are identical with Ubuntu 22.04.1 with Docker and Portainer for management. Installed containers are:

Pi-Hole

Cloudflared (provide DoH to Pi-Hole)

UniFi Controller

WatchTower (keep everything updated automatically)

 

The 2 Pi-Holes are sync'd using gravity-sync

UniFi Controller is running on the primary, the secondary pihole has the controller installed but unconfigured. 

 

Backups are run weekly to my main NAS. If anything happens to the primary, I can just turn the second controller on and upload the config. 

 

 

Photos:

 

 

 

[kev507]

Joining the club of posting an update to add to my my old post that's still on the leaderboard somewhere

 

Hardware

• HPE ProLiant EasyConnect EC200a server w/ drive expansion chassis
• CPU: Intel Xeon CPU D-1518 
• Network: Intel 366i + iLO 4 OOBM port
• RAM: 64GB DDR4 ECC RDIMM (2 x 32GB DDR4-2400)
• Boot drive: Inland 240GB M.2 PCIE 3.0 x4
• Data drives: 6 x 8TB Seagate IronWolf (ZFS RAIDZ 2)

Total capacity: 48TB (raw), 32TB usable space

 

Software and Configuration:

TrueNAS Scale mostly used to pull/push cloud backups and run VMs as needed.

 

Backup:

TrueNAS pulls daily backups from OneDrive, Google Photos, etc and then pushes changes to Backblaze B2 creating a 4-way backup solution (where the data was created, initial cloud storage, NAS, and Backblaze B2)

 

Photos:

 

 

 

 

[The_Mole]

Hello,

if you guys are passing the yardstick around, then who am I to not join the contest?

Here's my current NAS:

Hardware

• PC: Fujitsu Esprimo E710 E85+ (old SFF office PC)
• CPU: Intel Xeon E3-1265L v2 (Ivy Bridge based)
• RAM: 4x 2GB DDR3 (the DIMMs it came with)
• HBA: 2x Fujitsu D2607-A21 crossflashed with LSI 9211-8i in IT Mode
• Boot drive: some random USB Stick
• RAID drives: 16 x 2TB Seagate ST2000LM015 2.5" (via HBA)
• RAID: SHR-2 (2 parity drives)
• Cache drives: 1 x 500GB Samsung 840 EVO 2.5" (via onboard SATA)
• OS: Redpill Loader + Synology DSM 7

Total capacity: 32.5TB (raw), 24.4TiB useable space

 

 

Usage:

Media storage, private cloud & BOINC b*tch. 

 

 

Build:

I started this build like 8 years ago, when I still worked as client support agent. The PC was saved from e-waste (with consent) so were the first hard drives that went into it and bit by bit it evolved into its current state. The PCI-slot drive caddy was drafted on a mail envelope and then cut out of the top cover of a broken Cisco switch. The front caddies are ICY DOCK knock-offs from AliExpress. I did my best to put as many drives into and I think I could have done worse. Drive temps range from 34°C/93°F to 45°C/113°F depending on where the respective disk sits. CPU is at 58°C/136°F.

Frankly, I didn't expect the tin to cling to life like that and last this long. However, now I'm finally out of options to add more drives. Vendors never came out with 9mm tall HDDs larger than 2TB, I'm afraid I have to build a successor. For that, I expect a Fractal Design Node 804 by the end of February...

 

 

Pics:

8 drives in the front

2 drives in the 3.5" bay, 2 more in a caddy below the drive-lid, another 4 at the PCI slots and the SSD is slapped against the PSU with a strip of DSDT.

 

Cardboard template for the slot-caddy (with old drives)

 

Failed fan replaced 

 

DSM Info:

 

Drives:

 

 

 

 

[kev507]

Endgame NAS (for now)

 

Hardware

• HPE ProLiant ML110 Gen10
• CPU: Intel Xeon Silver 4208
• Data Network: Intel X710-T2L 10Gb 2-port
• OOBM Network: iLO5 1Gb port
• RAM: 192GB DDR4 ECC RDIMM (6 x 32GB DDR4-2400)
• Boot pool: 2x SK Hynix 480GB NVME (mirror)
• SSD pool: 4x 4TB Crucial P3 NVME (stripe of mirrors)
• HDD pool: 8x 8TB Seagate IronWolf (ZFS RAIDZ 2)

SSD Total capacity: 16TB raw, 8TB usable 

HDD Total capacity: 64TB raw, 48TB usable 

 

Software and Configuration:

TrueNAS Scale mostly used to pull/push cloud backups and run VMs as needed.

 

Backup:

TrueNAS pulls daily backups from OneDrive, Google Photos, etc and then pushes changes to Backblaze B2 creating a 4-way backup solution (where the data was created, initial cloud storage, NAS, and Backblaze B2)

 

Photos:

 

s

 

[Hazgebu]

My Data hoarder and game host server:

 

Hardware:
CASE: Nanoxia Deep Silence 3

PSU: Seasonic Prime PX650 80plus Platinum

MB: ASRock B550 PG Riptide

CPU: AMD 5600G

HS: MSI Frozr L (or XL idk)

RAM: 64GB Corsair Vengeance 3200MHz DDR4 (2*32GB)

Network: 2,5Gbit onboard

HBA: Some LSI(?) SAS used from ebay (up to 8 drives max)

SSD: 2 x 1TB Samsung 980

HDD 1: 5 x 4TB Seagate Ironwolf ST4000VN008

HDD 2: 1 x 4TB Seagate Ironwolf ST4000VN006

UPS: APC Back-UPS RS 900G

Power: Idel usage: 50W

Power: Disk activity: 70W

Power: High CPU usage+High Disk activity: 90W

 

 

Software and Configuration:
OS: Unraid Pro 6.11.5

unRAID config: 4 Data disks, 2 parity. Plus the redundant ssd Cache pool

Capacity: 16TB usable HDD space, 1TB usable ssd space

 

Usage:
Storing stuff, 3d printer control (octoprint), game host (minecraft, ark survival evolved, valheim, astroneer, etc.), nextcloud host,

Backup:
Maybe a 2*2TB backup server incoming for the important stuff

 

Photo's: (Nobody got time for cable managing a server that noone can see)

[DX250]

Hardware:
HPE DL380p

3x Dell SC220 disk shelves

CPU: 2x Intel Xeon E5-2670

RAM: 96GB HPE Micron ECC DDR3

Network: Dual 10gb sfp+

RAID CARD: IBM M1015 converted to LSI9211-IT mode

HBA: LSI 9200-16e, LSI 9207-8e, HP Smart Array P420i

SSD: 2x TeamGroup 1tb nvme (Storage), 3 TeamGroup 256GB nvme (boot/cache/log), 1 Teamgroup 128GB (boot)

HDD: 6x 14TB Seagate Exos Sata (Storage)

HDD: 6x 8TB WD schucked drives (storage)

HDD: 1x Seagate Exos 8TB (storage)

HDD: 26x Seagate 2TB Enterprise (Storage)

HDD: 1x WD Green (Storage)

UPS: 2x TrippLite 3KW

Rack: 36U Open Rack

Software and Configuration:
OS: TrueNas Core

RAID config:  Z5 26x 2TB in 3 vdev's of 8 with 2 spares, Z6 6x 14TB and 6x 8TB with an additional 8TB spare and a 256GB log and cache, Z1 2x 1TB ssd, 1x 1TB

RAID hot spare: 2 x 2TB, 1x 8TB

File system: zfs

Capacity: 195TB raw, 113TiB usable
 

Usage:Bulk storage, Plex, Editing.

Backup: Off site LTO 5 tape

 

I will be adding another 6x 14TB vdev with a 14TB spare and replacing the DL380p with an AMD Epyc build later this year. One ups is out because I am replacing the batteries in all of them.
 

Photo's:

[The_Unicorn]

It looks like they are not updating the scoreboard anymore. My system is similar to yours but with 340TB raw drives.

 

We both should be near the top.

[MG2R]

Let’s try @alpenwasser xD

[SakuraChan]

On 7/24/2023 at 4:52 AM, The_Unicorn said:

It looks like they are not updating the scoreboard anymore. My system is similar to yours but with 340TB raw drives.

 

We both should be near the top.

LOL yeah I haven't updated my post in forever however

 

 

[The_Unicorn]

13 hours ago, SakuraChan said:

LOL yeah I haven't updated my post in forever however

 

 

 

Is that multiple systems, just guessing by the names?

 

My multiple servers are

New Server      336TB

Old Sever          108TB

Old Server         108TB

Editshare 10GbE 64TB

Promise FC         64TB

Promise FC         32TB

Isilion 2RU          24TB

Old Editshare     10TB

Totalling 778TB

 

Then

2011 iMac with 24TB

2010 Mac pro 16TB

2015 MacBookPro with 8TB

 

My storage is only 1/3 used so far.

 

[SakuraChan]

17 hours ago, The_Unicorn said:

 

Is that multiple systems, just guessing by the names?

 

My multiple servers are

New Server      336TB

Old Sever          108TB

Old Server         108TB

Editshare 10GbE 64TB

Promise FC         64TB

Promise FC         32TB

Isilion 2RU          24TB

Old Editshare     10TB

Totalling 778TB

 

Then

2011 iMac with 24TB

2010 Mac pro 16TB

2015 MacBookPro with 8TB

 

My storage is only 1/3 used so far.

 

last 4 are other systems in the rack, full rack, and rear network switches, upgraded to 40GbE Networking was fun and kinda cheap now

[MG2R]

1 hour ago, SakuraChan said:

last 4 are other systems in the rack, full rack

 

<sweats in Belgian power pricing> 

[aggie113]

Synology NAS RS3617xs

 

Bought used on eBay for $350 (driveless)
currently about 60% full.
 

Hardware:
CASE: Synology

PSU: ?

MB: Synology

CPU: INTEL Xeon E3-1230 v2

RAM: 32 GB

Network: Broadcom BCM57810S enabled 10Gb SFP+ PCI-E card running fiber module

RAID CARD: ?

HDD 1: 12 x Seagate IronWolf 12TB ST12000VN0008

 

UPS: APC Smart UPS C 1500

Rack: bread rack
Replaced cooling fans with Noctua units and ran custom script to let the system run in quiet mode.

 

 

 

Software and Configuration:
OS: Synology DSM 7.2.1-69057 Update 1

RAID config: single volume RAID 5

RAID hot spare: nope, cold spare only

File system: ext4
File system capacity: 120TB

 

Usage:
Storing stuff, you know, it is a storage server.

Backup:
What?

 

Photo's:

 

[giosann]

NAS/Hoarding thingy

 

Hardware:
CASE: Silverstone DS380, swapped the fans with noctuas. I also had a friend 3D print these to improve airflow to the drives

PSU: Corsair SF600 Platinum

MB: ASRock H670M-ITX/ax

CPU: Intel Core i5-12500

HS: Intel Stock Cooler

RAM: 2X16GB Crucial DDR4-3200 (CT16G4DFRA32A)

Network: onboard (1 Gbit + 2,5 Gbit)

HBA: LSI 9207-8i (IBM M5110)

SSD: 4 x 1TB Crucial MX500

HDD 1: 3 x 18TB TOSHIBA MG09

HDD 2: 3 x 18TB Seagate Exos X18

 

Software and Configuration:
OS: Unraid Pro 6.12.6

unRAID config: 4 Data disks, 2 parity. SSD are used for cache, appdata and system

Capacity: 72TB usable HDD space, 2TB usable ssd space

 

Usage:
A lot of Linux ISOs, a lot of miscellaneous hoarding. Some web apps and experimenting/having fun/learning some things

 

Backup:
What is that?

 

Photos:

In the End I hated the case

Spoiler

Cable Management? ew

Nice rat nest

Location in the previous home, Not the best but it wasn't falling down on its own, at least i had 1000/200 internet...

Current location, now 100/30 internet speed... sadness. Eventually the plan is to translant it to a rackmounted solution.

Unraid Main Page

Dockers

Conclusion:

To be honest I really don't know what I am doing, but it's been fun.

The medium term plan is that once i have good ethernet runs for the home the rack will be in a better with the NAS also rackmounted (I'm looking at the Silverstone RM43-320-RS)
Also hopefully one day I'll get good fiber internet here.

[equalexpert]

Hardware

CASE: Logic Case SC-316

PSU: Corsair MX650

MB: ROG STRIX B450-F GAMING II

CPU: Ryzen 5 3600

HS: Stock AMD heatsink

RAM: 32GB DDR4 3000MHz

RAID CARD 1: LSI SAS 9210-8i - it mode

RAID CARD 2:  LSI SAS 9210-8i - it mode

SSD 1: Samsung 980 1TB NVMe

SSD 2: Kioxia Exceria 500GB NVMe

HDD 1: 2x 14TB Seagate

HDD 2: 5x 12TB Western Digital

HDD 3: 4x 12TB Seagate

HDD 4: 3x 6TB Seagate 

HDD 5: 2x 4TB Western Digital

Software and Configuration:

So this is my unRAID server hosting all my hoarding, standard media management dockers, a Windows 11 VM, a Minecraft server etc. Currently looking to swap out all the drives below 12TB and upgrade them as im very low on space. The RAID cards are managing 8 drives each but this might change to 1 card and an expander so i can add a disk shelf.

Usage:

I use the storage for movies and series, my Plex runs on a secondary unRAID box so this now just handles storage and organisation. The Minecraft server is hosted for a few friends and the VM runs some scraping tools that were just a bit nicer to get up and running in a Windows environment.

Backup:

None, i have a safety net of 1 parity drive. YOLO. I will eventually backup to Backblaze when new fibre lines are laid as 25mbps up is not going to go well. Any important docs/photos etc are backed up to OneDrive as then it syncs nicely between my main PC and laptops.

Additional info:

I swapped out the fans to Noctua Redux to reduce noise at the cost of heat as its currently in my 3x3m office. Currently have a post on the forum for fan advise and got some suggestions to try out.

Photo's:

Spoiler

Ive since added a rack PDU to the rear and waiting on a rackable switch to tidy the cables up more

[broken42]

Hardware

Server 1

CASE: SuperMicro CSE-826BE16-R920LPB

PSU: SuperMicro 80+ Platinum Redundant PSU

MB: ASRock Rack EPYCD8

CPU: Epyc 7282

HS: 2U Active Heatsink

RAM: 256GB DDR4 2666MHz

GPU: Tesla P4

HBA 1: LSI 9207-8i

HBA 2: LSI 9207-8e

Network: Mellanox ConnectX-3

JBOD 1: NetApp DS4246

JBOD 2: Dell EMC 2.5" 25 bay JBOD

Zpool 1: 24x6TB HDDs, RAIDZ1 6 VDEVS 4 wide

Zpool 2: 4x14TB HDDs, RAIDZ1 1 VDEV 4 wide

Zpool 3: 12x1TB SSDs, RAIDZ1 4 VDEVs 4 wide

Server 2

CASE: Rosewill RSV-R4000U

PSU: SuperMicro 80+ Platinum Redundant PSU

MB: Supermicro H11SSL-i

CPU: Epyc 7302p

HS: 4U Active Heatsink

RAM: 128GB DDR4 2933MHz

GPU: RTX 2060 KO

HBA: Random SATA HBA

Network: Mellanox ConnectX-3

Zpool: 4x4TB HDDs, RAIDZ1 1 VDEV 4 wide

Software and Configuration:

Server 1 is running TrueNAS Scale. The backplane of the case are connected to two MiniSAS HD ports on the motherboard and one of the ports on the 9207-8i. Both of the JBODs are connected to the 9207-8e. Server 2 is running Proxmox as one of my general hypervisor servers. One of the VMs it runs is my secondary backup server running TrueNAS with the HBA passed int through PCI-E passthrough.

Usage:

Server 1 runs the vast majority of my network storage and runs my entire media management suite, so the -arr stack as well as Plex. All of my Proxmox VMs backup to a docker version of Proxmox Backup Server running through the TrueNAS Scale apps. All of the Windows and Mac PCs also back up to this server. Server 2 is then a backup target for Server 1, the snapshots for the previously mentioned backups as well as all the Heavyscript backups of the application environment replicate to server 2 after their backup is finished. Server 2 also runs a second copy of Proxmox Backup Server that syncs with the primary install on server 1 twice daily.

Backup:

Server 1 does twice daily snapshots of the backup folders and the application environment. These are then replicated to server 2 once the snapshot is finished. The PVE environment backups 4 times a day to the primary PBS server on server 1 then server 2 pulls copies of those backups twice a day through it's own install of PBS. I need to figure out my plans for remote/offsite backups. Also my only "backup" for the media is the redundancy of RAIDZ1, 95 TBs of media is hell to backup.

Photo:

Spoiler