Stakacs

Hardware:
SERVER: IBM System x3650 M4 v2
CPU: 2 x Intel Xeon CPU E5-2680 @ 2.70GHz
RAM: 384GB
NIC: 3 x Intel X540-T2 10GB Dual Port Ethernet Adapter
RAID CARD 01: LSI SAS9207-8e 8-Port External HBA with "IT" firmware
RAID CARD 02: LSI SAS9207-8e 8-Port External HBA with "IT" firmware
RAID CARD 03: IBM M1015 with "IT" firmware
STORAGE: 3 x 36 Bay SuperMicro CSE-847E26-R1400LPB
SSD 01: 2 x 960GB ScanDisk Ultra II (SDSSDHI-960G)
SSD 02: 6 x 1TB Samsung SSD 860 EVO (MZ-76E1T0B/AM)
HHD 01: 66 x 5TB Toshiba X300 (HDWE150XZSTA)
HHD 02: 18 x 8TB WD 8TB My Book (WDBBGB0080HBK-NESN) shucked Ultrastar He10-8 SATA (WD80EZAZ)
SSD total capacity: 7.920TB (raw)
HHD total capacity: 474TB (raw)
 
Software and Configurations:
My IBM server is running FreeNAS 11.1-U7, the IBM backplane is connected to the internal IBM M1015 with the six SSD drives. In freenas it's setup with four vdevs (mirrored) with two drives per vdev, which is used for the virtual machines.
 
Next I have two LSI SAS9207-8e cards that connect externally with three SAS cables to the three 36 Bay SuperMicro CSE-847E26-R1400LPB which have a total of 84 drives. The 84 drives are setup in RAID-Z2, with 14 vdev's with six drives per vdev.
 
I present both zpools to vmware using iscsi, and the RAID-Z2 pool is setup for SMB.
 
Usage:
I use the storage to run all my virtual machines in vmware and to hold my large media, basically I run my own personal dropbox (seafile), email, game servers etc.
 
Backup:
I backup all the virtual machines to my RAID-Z2 pool, external qnap device, gdrive and LTO-6 tape drive.
 
Additonal info:
I currently have three esxi hosts connected to this storage, each esxi hosts has two Intel X540-T2 10GB cards to give me 40GB throughput for each hosts. My ISP provides 10G internet connect to the house.
 
Photo's/FreeNAS Info:
pool: Raidz_2_SATA state: ONLINE scan: scrub repaired 0 in 1 days 19:02:24 with 0 errors on Tue Jul 16 19:02:30 2019 config: NAME STATE READ WRITE CKSUM Raidz_2_SATA ONLINE 0 0 0 raidz2-0 ONLINE 0 0 0 gptid/c0d5e371-15a7-11e8-ab59-a0369f484a68 ONLINE 0 0 0 gptid/731d04df-9fd7-11e7-8ebe-3440b5b0233c ONLINE 0 0 0 gptid/25c4fcf6-9283-11e7-8ebe-3440b5b0233c ONLINE 0 0 0 gptid/e078d3f2-1bee-11e7-a096-3440b5b0233c ONLINE 0 0 0 gptid/707e7c41-891c-11e7-8d2a-3440b5b0233c ONLINE 0 0 0 gptid/dd4e684f-9f14-11e7-8ebe-3440b5b0233c ONLINE 0 0 0 raidz2-1 ONLINE 0 0 0 gptid/cf88ceb0-165c-11e8-ab59-a0369f484a68 ONLINE 0 0 0 gptid/08c08b57-1724-11e8-ab59-a0369f484a68 ONLINE 0 0 0 gptid/f57817a3-17f3-11e8-ab59-a0369f484a68 ONLINE 0 0 0 gptid/c266fc1a-18c9-11e8-ab59-a0369f484a68 ONLINE 0 0 0 gptid/a1d42969-193e-11e8-b2bc-a0369f484a68 ONLINE 0 0 0 gptid/ce9ac33c-19a5-11e8-b2bc-a0369f484a68 ONLINE 0 0 0 raidz2-2 ONLINE 0 0 0 gptid/8a305bc3-b5fd-11e8-bc7a-a0369f484a68 ONLINE 0 0 0 gptid/7e1eadaa-b64c-11e8-bc7a-a0369f484a68 ONLINE 0 0 0 gptid/fafc4062-b6d7-11e8-b121-a0369f484a68 ONLINE 0 0 0 gptid/41a15fff-0a22-11e9-890f-a0369f484a68 ONLINE 0 0 0 gptid/bdd63c8a-b77e-11e8-b121-a0369f484a68 ONLINE 0 0 0 gptid/a4449699-b7d1-11e8-b121-a0369f484a68 ONLINE 0 0 0 raidz2-3 ONLINE 0 0 0 gptid/58a70f71-b763-11e6-9118-3440b5b0233c ONLINE 0 0 0 gptid/8769c8e0-c325-11e6-9118-3440b5b0233c ONLINE 0 0 0 gptid/e190fb70-c29e-11e6-9118-3440b5b0233c ONLINE 0 0 0 gptid/b4313200-c0a8-11e6-9118-3440b5b0233c ONLINE 0 0 0 gptid/bfe5c8f8-a796-11e6-9118-3440b5b0233c ONLINE 0 0 0 gptid/eb24c94c-1d82-11e8-b2bc-a0369f484a68 ONLINE 0 0 0 raidz2-4 ONLINE 0 0 0 gptid/0ebeae35-d9f5-11e7-b15a-a0369f484a68 ONLINE 0 0 0 gptid/5c9b81c3-e50b-11e7-a57a-a0369f484a68 ONLINE 0 0 0 gptid/e1738310-daf0-11e7-b15a-a0369f484a68 ONLINE 0 0 0 gptid/e2c55c3f-d8cb-11e7-b15a-a0369f484a68 ONLINE 0 0 0 gptid/62de80ff-d79d-11e7-a3c8-a0369f484a68 ONLINE 0 0 0 gptid/ca314311-d62e-11e7-a3c8-a0369f484a68 ONLINE 0 0 0 raidz2-5 ONLINE 0 0 0 gptid/c55c76b7-d9f4-11e7-b15a-a0369f484a68 ONLINE 0 0 0 gptid/beacf4e9-dbf8-11e7-b15a-a0369f484a68 ONLINE 0 0 0 gptid/6297aa25-daf0-11e7-b15a-a0369f484a68 ONLINE 0 0 0 gptid/9f689504-d8cb-11e7-b15a-a0369f484a68 ONLINE 0 0 0 gptid/722cf68d-d71e-11e7-a3c8-a0369f484a68 ONLINE 0 0 0 gptid/85d6f320-d62e-11e7-a3c8-a0369f484a68 ONLINE 0 0 0 raidz2-6 ONLINE 0 0 0 gptid/2a5228d8-8a12-11e5-9905-3440b5b0233c ONLINE 0 0 0 gptid/2b8c0b23-8a12-11e5-9905-3440b5b0233c ONLINE 0 0 0 gptid/2cc53e86-8a12-11e5-9905-3440b5b0233c ONLINE 0 0 0 gptid/2e0403b9-8a12-11e5-9905-3440b5b0233c ONLINE 0 0 0 gptid/2f3e74bf-8a12-11e5-9905-3440b5b0233c ONLINE 0 0 0 gptid/3076d876-8a12-11e5-9905-3440b5b0233c ONLINE 0 0 0 raidz2-7 ONLINE 0 0 0 gptid/70c3d74e-b33a-11e5-83e2-3440b5b0233c ONLINE 0 0 0 gptid/72c3e734-b33a-11e5-83e2-3440b5b0233c ONLINE 0 0 0 gptid/74c1d3e1-b33a-11e5-83e2-3440b5b0233c ONLINE 0 0 0 gptid/76a320ea-b33a-11e5-83e2-3440b5b0233c ONLINE 0 0 0 gptid/787028e4-b33a-11e5-83e2-3440b5b0233c ONLINE 0 0 0 gptid/7a4744e8-b33a-11e5-83e2-3440b5b0233c ONLINE 0 0 0 raidz2-8 ONLINE 0 0 0 gptid/df118278-ed2e-11e5-aaaf-3440b5b0233c ONLINE 0 0 0 gptid/e00ae5d7-ed2e-11e5-aaaf-3440b5b0233c ONLINE 0 0 0 gptid/e10dc1c8-ed2e-11e5-aaaf-3440b5b0233c ONLINE 0 0 0 gptid/e2121190-ed2e-11e5-aaaf-3440b5b0233c ONLINE 0 0 0 gptid/e306c84f-ed2e-11e5-aaaf-3440b5b0233c ONLINE 0 0 0 gptid/e3f9b4dc-ed2e-11e5-aaaf-3440b5b0233c ONLINE 0 0 0 raidz2-9 ONLINE 0 0 0 gptid/456df18a-ed2f-11e5-aaaf-3440b5b0233c ONLINE 0 0 0 gptid/465657e6-ed2f-11e5-aaaf-3440b5b0233c ONLINE 0 0 0 gptid/47418cad-ed2f-11e5-aaaf-3440b5b0233c ONLINE 0 0 0 gptid/4826457b-ed2f-11e5-aaaf-3440b5b0233c ONLINE 0 0 0 gptid/490ee34f-ed2f-11e5-aaaf-3440b5b0233c ONLINE 0 0 0 gptid/4a01eb1f-ed2f-11e5-aaaf-3440b5b0233c ONLINE 0 0 0 raidz2-10 ONLINE 0 0 0 gptid/39be88a8-1beb-11e7-a096-3440b5b0233c ONLINE 0 0 0 gptid/3b34d341-1beb-11e7-a096-3440b5b0233c ONLINE 0 0 0 gptid/3c5d28df-1beb-11e7-a096-3440b5b0233c ONLINE 0 0 0 gptid/3d7920e3-1beb-11e7-a096-3440b5b0233c ONLINE 0 0 0 gptid/3edca0cf-1beb-11e7-a096-3440b5b0233c ONLINE 0 0 0 gptid/3ff30819-1beb-11e7-a096-3440b5b0233c ONLINE 0 0 0 raidz2-11 ONLINE 0 0 0 gptid/fa7ec530-b64c-11e8-bc7a-a0369f484a68 ONLINE 0 0 0 gptid/6e60fc6e-b6d8-11e8-b121-a0369f484a68 ONLINE 0 0 0 gptid/e2265afd-b77f-11e8-b121-a0369f484a68 ONLINE 0 0 0 gptid/b8ed3d10-b724-11e8-b121-a0369f484a68 ONLINE 0 0 0 gptid/162c05d7-b7d3-11e8-b121-a0369f484a68 ONLINE 0 0 0 gptid/f4ed5ea8-b5fc-11e8-bc7a-a0369f484a68 ONLINE 0 0 0 raidz2-12 ONLINE 0 0 0 gptid/71c4646d-b77f-11e8-b121-a0369f484a68 ONLINE 0 0 0 gptid/444ad7d3-b725-11e8-b121-a0369f484a68 ONLINE 0 0 0 gptid/f952906a-b6d8-11e8-b121-a0369f484a68 ONLINE 0 0 0 gptid/85674958-b64d-11e8-bc7a-a0369f484a68 ONLINE 0 0 0 gptid/8788fd86-b5fc-11e8-bc7a-a0369f484a68 ONLINE 0 0 0 gptid/1d9eb7c6-b7d2-11e8-b121-a0369f484a68 ONLINE 0 0 0 raidz2-13 ONLINE 0 0 0 gptid/af9f90f6-9069-11e8-b9d5-a0369f484a68 ONLINE 0 0 0 gptid/b12bb3dd-9069-11e8-b9d5-a0369f484a68 ONLINE 0 0 0 gptid/b2c15ad1-9069-11e8-b9d5-a0369f484a68 ONLINE 0 0 0 gptid/b44ffec6-9069-11e8-b9d5-a0369f484a68 ONLINE 0 0 0 gptid/b5ebeadd-9069-11e8-b9d5-a0369f484a68 ONLINE 0 0 0 gptid/b7aa1120-9069-11e8-b9d5-a0369f484a68 ONLINE 0 0 0 pool: Raidz_VMware_SSD state: ONLINE scan: resilvered 467G in 0 days 00:24:06 with 0 errors on Fri Jul 19 19:45:32 2019 config: NAME STATE READ WRITE CKSUM Raidz_VMware_SSD ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 gptid/e4a59571-aa7e-11e9-80cf-a0369f484a68 ONLINE 0 0 0 gptid/4584cc52-aa84-11e9-80cf-a0369f484a68 ONLINE 0 0 0 mirror-1 ONLINE 0 0 0 gptid/4dfca7d9-8da5-11e9-b1aa-a0369f484a68 ONLINE 0 0 0 gptid/799d7a4c-8e7a-11e9-b1aa-a0369f484a68 ONLINE 0 0 0 mirror-2 ONLINE 0 0 0 gptid/00ae5d7e-ec99-11e5-a41c-3440b5b0233c ONLINE 0 0 0 gptid/02072c05-ec99-11e5-a41c-3440b5b0233c ONLINE 0 0 0 mirror-3 ONLINE 0 0 0 gptid/3a47f312-a266-11e8-826f-a0369f484a68 ONLINE 0 0 0 gptid/3b4a66a9-a266-11e8-826f-a0369f484a68 ONLINE 0 0 0  

alright time for an update 161TB storage with 2x4U servers filled with 48x4TB drives, 2 pools, both Hardware RAID6
 
48x WL4000GSA6472E  (White Label Enterprise drives from GoHardDrive.com)

WOW - that is one big ass cache drive  /s ?

Hardware
Motherboard: ASRock - Z77 Pro4-M CPU: Intel® Xeon® CPU E31245 @ 3.30GHz CPU cooler: Intel Stock GPU: None RAM: 24GB Random DDR3 1066MHz PSU: Unknown 750W Gold Boot drive: Random 16gb Flash Drive Storage drives: 2x4TB Seagate NAS Storage drives: 10x8TB WD Easystores Storage drive: 1x10TB WD Easystores Cache drive: 1x512TB Crucial SSD Case: Rosewell 12 bay hot swap + Unknown Max ATX Case Total capacity: 98TB (raw), 80TB useable, Score: 80 * ln (13) = 205.195948597
 
Software and Configuration:
Running unRAID for 4 years now. Moved from ubtuntu RAID 5 and never looked back (only x3 4TB drives then). WD drives are in a rosewell 4U case with the rest of the main hardware, then using external SAS expansion cables and card to extend to a case I got in trade for light IT work that has 10 front 5.25" bays which I put hot swap bays in. Makes me a little nervous but for now it will work.
 
Usage:
Personal/Friends NAS, web server, Media Storage, PLEX, Docker Host.
8382 Movies, 56345 Episodes
It is an addiction, and I need to find a cheaper source of drives (best buy easystores so far).
Sits in my server room (read: laundry room) on a spare bar stool which has my linux sandbox and router (thinkpad T60) on the lower foot stools.
 
Backup:
Backing up to GDrive, 12/80TB so far. Maybe in a few years it will be done.
 
 
Photos:

Had 32x 850 Pro 2TB drives arrive today.
 
Would be fun to play with them in a massive RAID0 config if I wasn't on a time crunch.
 

Please follow the template on the first page (the very first build post in the thread) so that we have details like the size, count, and manufacturer of you hard drives. Those are used to place you in the ranking and make the graphs about how many drives we have combined.

It's called physics.

Hardware
CASE: Fractal Design Node 804
PSU: Seasonic SS-760XP
MB: Asus P9D-M
CPU: Intel Xeon E3-1231 v3
HS:  Noctua NH-C14S
RAM: 2 * 4GB DDR3L ECC (Kingston KVR16LE11S8/4KF)
RAID CARD 1: SAS9211-8I (Flashes to IT)
SSD: 2 * Samsung SSD 850 PRO 128GB
HDD 1: 8 * WD 6TB red (WDC WD60EFRX-68L0BN1)
Software and Configuration:
My server is running FreeBSD 11 and I'm using ZFS to manage a RAID 10 pool. 
My array consists of 8 6TB WD drives in RAID 10. This gives 21 TB of real availability from the pool. 
Currently I am using Samba to connect to my desktop, I will be setting up iSCSI to share space with an ESXi host. 
Usage:
I use the storage for movies and series, Run plex on the server and I connect to it for local playback. 
It will be used as a datastore for an ESXi host. 
Backup:
Hopes and dreams.
Additional info:
I'm looking at increasing the memory and running bhyve since the CPU is woefully underutilized. I would mostly be shifting the services into VMs and possibly running related VMs on it. 
I used RAID 10 for ease of recovery and lower overhead on high write operations. 
I use identical sized partitions in my ZFS pool rather than direct drive size as this prevents possible issues if a replacement drive is a different size by a MB or two.
Photo's:

4 deep on each stack. The SSDs are installed in a section in the front panel. I installed the PSU upside down and couldn't be bothered to rewire it all after I realized. 

On the plus side, I never have problems with heat. 

Nothing fancy, but it keeps it off the floor so it doesn't suck up as much dust and lint. 


Pool status and capacity. 
 
EDIT: Yes, I'm a bad for running as root. I was lazy and had to install and modify some services. 

Well I am turning an 8 year old AIO into a custom loop using 3 different tubing sizes by cramming tubing into tubing and hose clamps..

Are you sure about that power consumption @Stakacs? The computer alone should idle close to 40watts without a dedicated graphics card and 1 drive. 

Update! *yay*
 
I have some new drives and whatnot
 
This is now the full list of drives in this system:
8x 4TB WD Red
6x 2TB Seagate NAS HDD
2x 1,5TB Seagate Barracuda
1x 3TB Seagate Barracuda
 
The server is still running Windows Storage Spaces, but has been upgraded to Server 2012 R2.


 

WinterFell (Ubuntu 16.04)
 
CPU: Intel® Core™ i7-2600 Processor (8M Cache, up to 3.80 GHz) 
Motherboard: Asus P8Z77-V LX
Boot Drive: OCZ Agility 3 60GB
RAM: 32GB DDR3 (4x8GB HyperX FURY)
HDD Config 1: (3x 3TB 3.5in WD RED in ZFS RAIDZ1) (3x 10TB 3.5in Seagate IronWolf in ZFS RAIDZ1 again) (22.9GB usable)
HDD Config 2: 2x 1TB 2.5in WD RED in ZFS Mirror for Virtual Machine Storage. Mainly for Linux Containers, which run EMBY, Torrent Server, Sonarr, Radarr, VPN Server, Apache, all in their own containers, which stops package version conflicts. Also backups up important data from HDD config 1
SSD Cache Drive: Samsung SSD 850 EVO 250GB for Main Storage Pool (L2ARC)
SSD Cache Drive: Transcend 128GB for LXC Container Pool (L2ARC)
UPS: APC Back-UPS Pro 900
HBA: Fujitsu D2607 (LSI 9211-8i IT MODE) Not in pictures as taken before hand.
 
Updated (02/04/2018)
 
See Below for images....
 
Future Plans....... Maybe
Moving to different case and add another Icydock for the 3x 3.5in inside (FatCage MB155SP-B or FatCage MB153SP-B). Maybe case like the Storm Trooper where it has 9 5.25in bays, or something similar.  Going to Ubuntu 18.04 little while after release. Inside shots (Updated 09/04/2015)
 

 
 

Watercooling! Part 1...
I'm in a bit hurry, but here is an short update!

2 radiators in place!
 

The watertank is mounted
 

Not the best bend, but it works
 

Flow and temperature sensors in place! Gonna have one temp sensor on both sides of the radiators - Would be fun to see the difference
 

I have learned (the hard way) that its smart to have a drainage port on the bottom of the loop :)
 

Lights are now implemented in the Arduino program
 
@GreenRay
 
 
 

Motherboard and radiator
 
A small update! I have mounted one radiator and the motherboard.
 

 

 

 

I'm planning to use an Arduino Uno to measure the flow and temperature, so I have made this prototype, and it works fine!
 
@GreenRay

xXx_PU$$YD35TR0Y3R_xXx

By saying "Stop".
 
And if that doesn't work...
Say "stop" again.

This dude is like the opposite of most people who haven't overclocked. Instead of taking caution and being extremely scared, this nigga goin full out GTA.

No such thing as future proof, nerd

So i finally decided to upload my beast internet speeds!
 

$110 a month btw

UPDATE #4 - ((((((((((Update #4 Changed Raid card//Added Additional 20TB of Storage//Added 16Gb more of Ram (total 32gb) ))))))))
 
 
 
Total Storage 
67.0TB
 
 
Server Name
Titan
 
Hardware
CASE: Lian Li 343B
PSU: Corsair TX850
MB: Gigabyte 990FXA
CPU: AMD FX - 8120 @ Stock
HS: Noctua NH-D14
RAM: 32GB DDR3 1600 GSkill Ram
RAID CARD 1: Adaptec 52445 28 Port Raid Card
SSD: Samsung 840 EVO 120GB
Enclosures: Startech 2 5.25 for 3 HDD (6) 
HD's: 
13x 2TB Western Digital (Red) WD20EFRS
9x 2TB Western Digital Greens (Various Models) 
1x 3TB Western Digital WD30EZRS
3x 6TB Western Digital WD60EFRX
 
((( Update Added 7TB to Server )))
((((( Update # 2 Added 10TB More To Server ))))) 7/12/14
((((((( Update #3 Replaced a Failed 2TB//Added Additional 2TB//Changed Operating System//CPU, Motherboard Upgraded)))))))
((((((((((Update #4 Changed Raid card//Added Additional 20TB of Storage//Added 16Gb more of Ram (total 32gb) ))))))))
 
Software and Configuration:
My server is running Windows 8.1, I have one Raid 6 Array with 23 drives (22 X 2TB =44TB).  This array holds all my movies/tv shows and data.  I have a 5TB (3TB + 2TB) drive that I use for backup for my software that is synced to nightly with Syncback Pro on top of my cloud storage which is mentioned in the backup section.  Second Array is 3 x 6TB (18TB) for Backup Purposes). 
 
Usage:
I use my server as my media hub for my entire house and beyond.  I have 2 WD TV Media players in different rooms in the house which can remotely access my server.  I also utilize my server to access Air Video remotely on my Idevices, and it also serves as my security system monitoring cameras placed around the house.
 
Backup:
My Server is connected to Crashplan which stores my data off site.
 
Additional info:
Server now running 8.1 after some tweaks to add start menu and better functionality, looking forward to Windows 10!
 
 
 
Photo's:
               
 
 
 

 

I'm new in this thread, and fairly new to the forum in general, so i thought i would "pop my cherry" so to speak by showing off my little baby
 
Hardware:
 
CPUs: 2x Xeon E5-2603 v3
RAM: Kingston DDR4 2133MHz ECC 32GB (4x8gb)
Motherboard: Supermicro MB X10DRL-i Dual Xeon E5 v3
PSU: Redundant 960w 80Plus Platinum PSU (Comes with the case)
Case: Supermicro SuperChassis 846BA-R920B
Boot-drive: 128Gb OCZ Agility 3
Drives: Different sizes. Mostly 2TB and 4TB WD Red, but there are some mixing and matching going on. Totals at 34,6TB usable space.
Controllers: LSI MegaRAID SAS 9211-8i & HighPoint RocketRaid 2320 (Just for the ports, really)
 
Software:
 
The server is running Microsofts StorageSpaces on Windows Server 2012. It fits my drive config, and the speed is perfectly fine for gigabit connectivity. 
 
I'm only using this as a file / Plex server at the moment, but it probably will be used for some Hyper-V stuff later on.
 
The storage is configured as one drive-pool with two virtual disks. One big disk for media configured as parity, and one smaller disk for documents and more important stuff which is configured as a mirror over three drives, and is backed up using Jottacloud aswell.
 

 

 
(The inside is super-messy, i know. Something will be done, some day.)

<post removed>

Update #1 Click Here
 
This is my first dedicated server/nas. Previously I had been serving the media and file sharing for my home network with my main desktop machine, it has a 17TB Flexraid setup that is still going but now only for redundancy. The new machine is running the latest FreeNAS with various plugins.
 
Specs below.
 
 
24TB Advertised, I am using a Raidz2 8 disk array, for 16.4TB Usable and can lose 2 drives before game over.
 
FreeNas is running off a 16GB USB 2.0 drive
 
CASE: Fractal Design R5 Black No window
PSU: Corsair CS450M GOLD Cert
MB: Supermicro X10SLL-F
CPU: Intel Xeon E3-1231V3 Haswell 3.4GHz 
HS: Noctua NH-U9S
RAM: 32GB Crucial DDR3 ECC 4x8GB
RAID CARD 1: LSI 9211-8i flashed with P16IT Firmware
HDD: 8x TOSHIBA PH3300U-1I72 3TB 7200 RPM
Fans: 2xFractal 140mm / 2x Noctua 120mm / 3x Noctua 140mm
 

 

 

 

I am in the process of a heavy upgrade to my storage system. Instead of running everything virtualized on a single machine I'm going to have a single purpose storage server providing iSCSI over infiniband to a pair of small VMWare hosts. I've already built the 2 hosts which work well over teamed 4x port gigabit NICs but seriously cant wait for the infiniband cards to arrive.
 
The storage server itself is going to be substantially rejigged to provide a high speed SSD datastore and large HDD datastore for the vmware boxes and a NAS datastore for the rest of the storage. Estimating 4x 512GB SSDs, 4x 6TB enterprise drives (with 128GB cache SSD) and 6x 6TB NAS drives should do a nice job.
 
Will post build pics as it all comes together for now here's one of the VMWare esxi mini Hosts:
 

New VMWare ESXi Host by TJ Stamp, on Flickr