Jump to content

My new OSNexus QuantaStor HA SAN

gcs8
 Share
Posted

So I have always wanted a ZFS HA SAN for the house, and a project at work introduced me to OSNexus QuantaStor, as well as their amazing CEO/CTO Steven Umbehocker who ended up handling my sales call during December a year or so ago while his sales staff was I guess doing holiday stuff. After talking with him about my personal setup he informed me that they have a free/community edition of their full-featured product, this includes HA, FC, scale up and out, and you can get up for 4 licenses to play with it kinda however you want. It is a bit of a learning curve coming from TrueNAS for the past 10+ years but overall, I am very happy with it. The community edition only supports 40T of raw storage under a single license, but for home use, that’s probably more than I am going to use for how I have things setup.

Anyway tl;dr, here is a look at my new ZFS HA SAN.

I am using a SuperMicro SBB 2028R-DE2CR24L. It is a dual node server where both nodes have access to all 24 SAS bays up front and even has room for SAS expansion out of the back. I have replaces the 10G NICs that came with it with 25G Broadcom P225P.

I am using 6 Samsung PM1643 3.84T SAS SSDs for the pool.

I have a RAM upgrade on the way to take this from 64G per node to 256G per node and for now, the dual E5-2650 v3’s are enough for the load that I am pushing.

I am running the QuantaStor Technology Preview version of the software so I can use ZSTD compression and be on a rather new build of OpenZFS as well as it being an easy upgrade path from QuantaStor 5 to QuantaStor 6 when it comes out.

 

s-l1600.thumb.jpg.4147935da50ab09c4461ffe5ad328a36.jpg

s-l1600-2.jpg.c0243ddcbb9e5f504dad2c20ff1d7a5b.jpg

1514591255_image(50).thumb.png.e83366274d7f6e89fc80d3c11bce4bfc.png

723528072_image(58).thumb.png.21878206547d3303611f8eedd005c54d.png

1144663446_image(57).thumb.png.9ad6e83cf5850e145f3729a13e6a6407.png

762942445_image(56).thumb.png.7e59e0ee7ed6330d7f1e97beeed9d36a.png

907484966_image(55).thumb.png.83ccfda87dcc05b5ba4fffa0bf2bd541.png

145363698_image(54).thumb.png.994e6bdc160cee3d37da04c265cf11f6.png

1489389987_image(53).thumb.png.5c293faa2346424c070f91f03e8e8e57.png

1952321440_image(52).thumb.png.10b6f40829c14adb8f1f15ad5c3626c6.png

1345226985_image(51).thumb.png.5f5d230eed249011a063f798fd1797be.png

 

 random IO. ~4,195.51MB/s read and ~3,713.16MB/s write

1620853386_Throughputtesting.thumb.png.eab9d2ff8cca6f732cf913f7ff60691a.png

 

Desktop

Intel® Xeon® E5-2630v4 2.2 2133 10C 1st CPU
Intel® Xeon® E5-2630v4 2.2 2133 10C 2nd CPU
HP Z840 1125W (1450W/200V) 90 Percent Efficient Chassis
512GB DDR4-2133(16x32GB) LRDIMM
NVIDIA GTX-770
HP 15-In-1 Media Card Reader
9.5 mm Slim DVD-Writer Optical Disc Drive
Intel(R) X540-T2 10GbE Dual Port Adapter

QLE2562 dual 8Gbps Fibre Channel
HP Z Cooler (2 Processors)
HP Chassis Intrusion Sensor

 

SAN/NAS

Intel® Xeon® E5-2630v4 2.2 2133 10C 1st CPU
Intel® Xeon® E5-2630v4 2.2 2133 10C 2nd CPU
768GB DDR4-2133(16x32GB) LRDIMM

Supermicro Rackmount 4U w/ Red. 1280W Platinum P/S
24x: Samsung DDR4 2133MHzCL15 32GB (PC4 2133) Internal Memory M386A4G40DM0-CPB
2x: Intel 2.20GHz Xeon E5-2630 v4 Deca-Core (10-Core), 25MB Intel Smart Cache, Socket-2011-v3 (FC-LGA14A)
12x: HGST Hard Drive [HUH728080AL5200] 8TB SAS 12Gb/s 7200RPM 3.5in, 128MB Buffer, Internal
Supermicro Motherboard S-2011 R3 for 2x E5-2600 v3 MFG Part Number: X10DRi-T4+
2x LSI Logic Controller Card H5-25573-00 9300-8i SGL SAS 8Port 12Gb/s PCIE3.0 HBA Brown Box

QLE2562 dual 8Gbps Fibre Channel
2x: Supermicro 4U Active CPU Heatsink f/ X9 Socket 2011 MFG Part Number: SNK-P0050AP4

Link to comment
Share on other sites
Link to post
Share on other sites
  • 2 months later...
Posted
  • Author

QS6 is now out and the community edition got a bump in space.

“Community Edition (60TB raw capacity limit per server, time-limited 2-year license, 4x servers max per storage grid)”

Desktop

Intel® Xeon® E5-2630v4 2.2 2133 10C 1st CPU
Intel® Xeon® E5-2630v4 2.2 2133 10C 2nd CPU
HP Z840 1125W (1450W/200V) 90 Percent Efficient Chassis
512GB DDR4-2133(16x32GB) LRDIMM
NVIDIA GTX-770
HP 15-In-1 Media Card Reader
9.5 mm Slim DVD-Writer Optical Disc Drive
Intel(R) X540-T2 10GbE Dual Port Adapter

QLE2562 dual 8Gbps Fibre Channel
HP Z Cooler (2 Processors)
HP Chassis Intrusion Sensor

 

SAN/NAS

Intel® Xeon® E5-2630v4 2.2 2133 10C 1st CPU
Intel® Xeon® E5-2630v4 2.2 2133 10C 2nd CPU
768GB DDR4-2133(16x32GB) LRDIMM

Supermicro Rackmount 4U w/ Red. 1280W Platinum P/S
24x: Samsung DDR4 2133MHzCL15 32GB (PC4 2133) Internal Memory M386A4G40DM0-CPB
2x: Intel 2.20GHz Xeon E5-2630 v4 Deca-Core (10-Core), 25MB Intel Smart Cache, Socket-2011-v3 (FC-LGA14A)
12x: HGST Hard Drive [HUH728080AL5200] 8TB SAS 12Gb/s 7200RPM 3.5in, 128MB Buffer, Internal
Supermicro Motherboard S-2011 R3 for 2x E5-2600 v3 MFG Part Number: X10DRi-T4+
2x LSI Logic Controller Card H5-25573-00 9300-8i SGL SAS 8Port 12Gb/s PCIE3.0 HBA Brown Box

QLE2562 dual 8Gbps Fibre Channel
2x: Supermicro 4U Active CPU Heatsink f/ X9 Socket 2011 MFG Part Number: SNK-P0050AP4

Link to comment
Share on other sites
Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
 Share
Go to topic listing Servers, NAS, and Home Lab

×