Need advice on All-Flash TrueNas/FreeNas setup and Dell PowerEdge R740XD or Supermicro SuperServer A+ SERVER 2113S-WN24RT

[pratikx13]

Hi I’m setting up a new NAS for production and I require an all-flash pool this is for a 12 to 14 TB space visualization studio working with 3d data and application like 3ds max blender Maya with 50+artist

read intense workload

Currently, we have this server with free nas
Server ConfigurationIntel
Xeon E5-2620 V3 @2.40GHz32Gb ram2x Intel I350-T4 Quad 1G Ethernet Server Adapter in LACP
OS FreeNAS 9.3 in 2x 120gb SSD Raid1
Volume Configuration
RAID-Z1 Single parity2TB x4 SATA NAS Hard Drives
250 GB SSD x2 read cache250 GB SSD write cache

Right now I’m checking these 3 options and planning to install TrueNAS CORE 12 need advice on any unforeseen issue with config and finalizing between these options

with all NVMe pool im not sure of write performance

Option 1 All NVMe pool
Supermicro SuperServer A+ SERVER 2113S-WN24RT 24 NVME Drives
1x Rome 7402P UP 24C/48T + 32GB DDR4-3200 2Rx4 ECC REG DIMM Total 256gb ram
Micron 5300 PRO 240GB, SATA, 2.5", x2 Hot-swap for os
3.84TB Micron 9300 PRO Series U.2 total 5 drive zpool
10-Gigabit Ethernet Network Adapter X710-T4 (4x RJ45)

Option 2 all NVMe pool
Dell PowerEdge R740XD Server l
Chassis up to 24 x 2.5 Hard Drives including 24 NVME Drives, 2CPU Configuration,
2x Intel Xeon Silver 4210R 2.4G, 10C/20T,
32GB RDIMM, 3200MT/s, Dual Rank Total 128GB ram
Dell 3.84TB NVMe, Data Center Read Intensive Express Flash, 2.5in with Carrier SFF U.2 AG
Intel X550 Quad Port 10GbE BASE-T, rNDC1

Option 3 SSD SAS + NVMe read-write cache
Dell PowerEdge R740XD Server
Chassis up to 24 x 2.5 Hard Drives including 12 NVME Drives,
2 x CPU Configuration12Intel Xeon Silver 4210R 2.4G, 10C/20T,
32GB RDIMM, 3200MT/s, Dual Rank Total 128GB ram
8x Dell 1.92TB SSD SAS Read Intensive 12Gbps 512 2.5in Hot-plug AG Drive, 1 DWPD zpool
3x Dell 960GB NVMe, Data Center Read Intensive Express Flash 2 read-cache 1 write cache
HBA330 Controller Adapter,
Intel X550 Quad Port 10GbE BASE-T, rNDC1

[Electronics Wizardy]

What is the rest of the infracture? what switches, wht management systems? What other servers?

 

What protocols are you using?

 

Why raidz, id go mirrors here.

 

 

zfs, used in truens doesnt support a write cache drive.

 

What quotes have you gotten?

[charlie_root]

Dell has better hardware QC than Supermicro in our experience at work. I'd get the Dell setup.

[pratikx13]

On 11/22/2020 at 9:53 PM, Electronics Wizardy said:

What is the rest of the infracture? what switches, wht management systems? What other servers?

 

What protocols are you using?

 

Why raidz, id go mirrors here.

 

 

zfs, uw

 

What quotes have you gotten?

Switch i will be getting 24x 10g for aggregation and  2x 10g uplink with 48 1g for distribution 

Cisco SG350X-48-K9-EU	Cisco -48x 10/100/1000 ports & 4x 10G ports (2x 10GBase-T/ SFP+ combo + 2x SFP+) managed switch
Cisco SG350XG-24T-K9-EU	Cisco -24x 10G 10GBase-T copper ports, 2x 10G SFP+ ports (combo with 2 copper ports) & 1x 1G management port

 

I have 60 windows workstation with 1g nic protocol will be SMB

 

pool set up im looking for recommendation i am targeting 12-14 TB usable space 

 

I'm located in Bangalore India

Quotes are from 14000$ to 15400$ for all nvme + tax

 

 

[Electronics Wizardy]

7 hours ago, pratikx13 said:

Switch i will be getting 24x 10g for aggregation and  2x 10g uplink with 48 1g for distribution 

 

Cisco SG350X-48-K9-EU	Cisco -48x 10/100/1000 ports & 4x 10G ports (2x 10GBase-T/ SFP+ combo + 2x SFP+) managed switch
Cisco SG350XG-24T-K9-EU	Cisco -24x 10G 10GBase-T copper ports, 2x 10G SFP+ ports (combo with 2 copper ports) & 1x 1G management port

 

I have 60 windows workstation with 1g nic protocol will be SMB

 

pool set up im looking for recommendation i am targeting 12-14 TB usable space 

 

I'm located in Bangalore India

Quotes are from 14000$ to 15400$ for all nvme + tax

 

 

Id be pretty darn tempted to go windows server with all windows clients, just seems to work better with permissions and active directory intergration.

 

Thats not that high brandwidth of switchs, so nvme will be nice, but sata or sas should work fine.

 

Id look at a dell r7415, seems like. a geood fit here, go with like 8x4tb ssds or 4x8tb ssds in raid 10.