Jump to content
Search In
  • More options...
Find results that contain...
Find results in...
looney

LTT Storage Rankings

Recommended Posts

8 hours ago, timdine said:

I may miss a few people that were updates but some new systems have been added: 

 

......

 

I'm going to update the github repository with the updates I've made to the configuration pages.  I'll keep an eye out for some updates and maybe try making another update then.  Or maybe just when I add some drives to try to get a better rank myself ;)

Sweet. Glad to see that this thread lives on and you have taken over the torch xD

 

It's this thread that lured me in to this forum, many, many moons ago, dreaming and drooling over humongous storage and dual Xeon systems :x B| 

Link to post
Share on other sites

Just a general heads-up:

 

I was abroad doing a crapload of overtime during spring, which meant basically no private live in the past few months. The good news is that I get to take lots of time off during the second half of the year, so I was planning to get around to this in the coming weeks. Nice to discover somebody has decided to help out! Many thanks to @timdine (and, uhm, apologies for the messy code :D ).


BUILD LOGS: HELIOS - Latest Update: 2015-SEP-06 ::: ZEUS - BOTW 2013-JUN-28 ::: APOLLO - Complete: 2014-MAY-10
OTHER STUFF: Cable Lacing Tutorial ::: What Is ZFS? ::: mincss Primer ::: LSI RAID Card Flashing Tutorial
FORUM INFO: Community Standards ::: The Moderating Team ::: 10TB+ Storage Showoff Topic

Link to post
Share on other sites
On 7/29/2018 at 12:54 AM, brwainer said:

Thanks! Unfortunately, none of the graphs are showing in the posting, and if I click the link for the .svg files I get an error that the attachment isn't available to me (like a permissions issue).

I see what is happening with the graphs, they're hosted out of a message conversation which I can see and the mod who helped post the code can see so it looked good when we tested it.  We'll find a way to change that shortly.  

 

Drive Heatmaps

OS Heatmaps

Rankings

 

Storage Systems

 

Timelines

 

Link to post
Share on other sites
4 hours ago, alpenwasser said:

Just a general heads-up:

 

I was abroad doing a crapload of overtime during spring, which meant basically no private live in the past few months. The good news is that I get to take lots of time off during the second half of the year, so I was planning to get around to this in the coming weeks. Nice to discover somebody has decided to help out! Many thanks to @timdine (and, uhm, apologies for the messy code :D ).

No problem.  It wasn't that bad to figure out.  You had it all hosted so that I could just fork it and go.  The documentation was close enough even if some of it still mentioned PERL that I added a couple modules to my installation and it worked.  The config json files were easy to figure out too.  Any critique of code for something of this purpose would be pretty subjective, it solves a problem, that's reasonable code.

 

This is absolutely one of the threads that I got reading, and still come back to, the forum for.  May as well keep it going.  It's a great idea building thread for something that isn't gaming.

Link to post
Share on other sites

Goro

 

Hardware:
CASE: NorcoTek RPC-4224

PSU: Corsair AX1200i

MB: Asus X99-E-10G WS

CPU: Intel Xeon E5-2620 v4

HS: Noctua NH U9DX i4

RAM: 128GB Crucial DDR4 2400 ECC

Network: Myricom 10G SFP+ 2 Ports

RAID CARD: 3 x LSI 9361 8i

Boot Disk: 2 x Samsung Fit 32GB USB (Mirror)

SSD: 2 x 250GB Samsung 850 EVO

HDD 1: 12 x 6TB WD RED Pro

HDD 2: 12 x 6TB WD RED Pro

Rack: Tripp-Lite 25U SmartRack 4-Post Open Frame Rack

 

 

Software and Configuration:
OS: FreeNas

RAID config: Raidz2 + Raidz2

File system: ZFS
File system capacity: 144 TB Total (105.5 TB Usable)

 

Usage:
General Storage / Backup / VMs

Backup:
Snapshots

Important Documents syncs to Drobo 5N with 5 x WD 4 TB Red Pro in Raid6

 

Photo's:

image.png.bebc99f27892dd78af62430b2d222f47.png

 

image.png

Link to post
Share on other sites

@Pyranicus How are the temps with the Norco case and the 6TB Drives? I found the WD Red Pro 8TB / WD Red 8TB are too fat/tall for adequate airflow to go over them in this chassis ... I imagine the 6TB drive might be a tad less tall, the 4TB drives are fine ... but I wasn't forcing the air over them with Delta fans or anything crazy (With enough static pressure it'd probably work) I was trying to keep things fairly quiet ...


i7-4770k @4.2GHz w/1.24v, Noctua NH-U14S, Gigabyte G1.Sniper Z87, 32GB DDR3 1600MHz w/1.56v, NVLink RTX2080Ti FE , RAID0 Samsung 840 Pro 256GB, RAID1 Samsung 850 Pro 512GB, Corsair RM850 PSU, Fractal Define R4

3x ASUS ROG PG279Q 144hz @7680x1440, Razer DeathAdder RGB Chroma, SteelSeries Apex M800 KB
Xeon E5-1650 v4 3.6GHz, Noctua U12DX i4, Crucial 32GB DDR4 2400MHz ECC Registered, Supermicro X10-SRi-F, IBM M1015 xF IT Mode, 12x WD Red Pro 8TB, 2x Samsung 960 Pro M.2 512GB, Corsair RM850 PSU, Corsair 900D, 4x Noctua NF-F12 PWM, 11x Noctua NF-F12 industrialPPC-2000, 1x NF-A14 PWM

Link to post
Share on other sites
On 8/1/2018 at 9:54 PM, sh4z said:

@Pyranicus How are the temps with the Norco case and the 6TB Drives? I found the WD Red Pro 8TB / WD Red 8TB are too fat/tall for adequate airflow to go over them in this chassis ... I imagine the 6TB drive might be a tad less tall, the 4TB drives are fine ... but I wasn't forcing the air over them with Delta fans or anything crazy (With enough static pressure it'd probably work) I was trying to keep things fairly quiet ...

The temps are not bad but I have Noctua fans running full speed, I have a fan on top of the raid cards and I put the whole setup in a separate area to minimize the noise.

Link to post
Share on other sites
On 7/28/2018 at 6:36 PM, timdine said:

I may miss a few people that were updates but some new systems have been added:

@snortingfrogs

@brwainer

@Poohy14

@Lurick

@TopWargamer

@Nemockulous

@handruin

@JK Vengeance

@porina

@Darkside447

@GreasyGaming

@deafboy

@Mikensan

@H3llscr3am

@dkuhn

@grimreeper132

@LAwLz

@kiddsupreme

@SakuraChan

@Thorn57

@gcs8

 

updates:

@b348xyx

@AnonymousGuy

@Mkvarner

@djdwosk97

@Helly

@Green_man_5

@unijab

@Night_Rider0

@Dr_Frankenstein

@dalekphalm

@Jarsky

 

I had to add a bunch of new OS and Drive types.  I also am sure I missed at least one system of note that didn't have five drives.  I'll go back and find that to add next time.  I was able to get colonel_mortis, one of the mods, to put in the html for me into the front page.  Big thanks for the help on that.  I'm going to update the github repository with the updates I've made to the configuration pages.  I'll keep an eye out for some updates and maybe try making another update then.  Or maybe just when I add some drives to try to get a better rank myself ;)

My System is updated as well whenever you get time to update it. 

 

 

Link to post
Share on other sites

I am not the one to flash my setups online, but I found this a bit interesting. My server is not really used enough, but it works very well for the use cases I have. Have been running my fileserver for a few years now (first files dates back to 2008 and before), but I recently upgraded the rig to get more local redundancy.

 

4x4TB disks configured with ZFS in raidz, giving a total of 11TB of usable storage. I also have an external disk with another 6TB of storage, totaling at 22TB of raw storage. This is all backed up to the cloud, offsite, aswell. The server is running Ubuntu 16.04, has 16GB ram and runs a i5 of some sort (4th gen I think). ZFS runs comfortably with this amount of RAM, and rarely exceeds 2-3GB ram (sometimes under heavy load this will go up quite a bit). 

 

From zpool status:

  pool: data
 state: ONLINE
  scan: scrub repaired 0 in 1h52m with 0 errors on Sun Aug 12 02:16:41 2018
config:

        NAME        STATE     READ WRITE CKSUM
        data        ONLINE       0     0     0
          raidz1-0  ONLINE       0     0     0
            sdb     ONLINE       0     0     0
            sdc     ONLINE       0     0     0
            sdd     ONLINE       0     0     0
            sde     ONLINE       0     0     0

And zpool list:

NAME   SIZE  ALLOC   FREE  EXPANDSZ   FRAG    CAP  DEDUP  HEALTH  ALTROOT
data  14.5T  1.09T  13.4T         -     4%     7%  1.00x  ONLINE  -

 

Link to post
Share on other sites

Update #3

Well here it is, the update i mentioned in my last post. Needed more space for my movies, so got that today :D.

Did change hardware, so to have it all in 1 place, ill re-post the list as it all is now.

 

Hardware

CASE: Cooler Master HAF Stacker 935.
PSU: Cooler Master Silent Pro M2 850W Modular
MB: Asus x99-Deluxe/U3.1
CPU: Intel Xeon E5-2620 v4 (2.1Ghz) (not overclockable, even 1 Mhz faster and it won't boot, probably cuz of the RAM)
HS: Noctua NH-D9L
RAM: 4x Kingston KTL-TS424E/8G - 8GB ECC

NIC: Asus PEB-10G/57840-2T
RAID CARD 1: Areca 1880i

SAS Expander Card: HP SAS Expander Card, 8 -> 24 Ports, Firmware 2.06.

Boot Drive: Samsung 960EVO M.2, 1TB

HDD 1: 8x 5TB WD Red
HDD 2: 5x 8TB WD Red (WD80EFAX)

 

PCPartpicker link

 

Software and Configuration:
Running Windows Server 2012 R2. Runs an FTP and Universal Media server to stream content to other devices. Server is also used to encode my bluray movies using makemkv and megui. Also using Hyper-V to run another instance of server 2012 R2 as a webserver with IIS.

My main array is the 8x WD's running in RAID-6. giving me a total of just over 27TB of usable space. Secondary array is the 5 8TB drives running in RAID-5.

 

Usage:

Storing my media files (movies and tv shows). currently almost 24TB in size. Files are usually copied over from my main PC over a 10Gbit connection to the server, which is a separate network between my 2 servers and main PC. The internet connection is a separate connection for now because i can't find a good affordable 10Gbit switch :P.

Backup:
Only the most difficult stuff to find is backed up to a few leftover drives i have lying around. The rest i just don't have the finances or the will to backup somewhere. So if the worst happens, i'm just screwed :P. I haven't had a drive fail in over 10 years (*knocks on wood*) so i'm good for now. I know this doesn't mean nothing will fail, i'm not a total idiot, even though this setup might make me look like one :P.


Sidenote:

So all the media files mentioned in my previous updates have been moved to my 2nd server. This leaves all the space i've got on the main server for the movies and tv shows which continue to grow each year.

Yes i also know i had a major SPOF in the 1880i right now. I will be on the lookout for 1882i cards and see if i can get a couple as backup. Should the 1880i fail a 1882 should be able to take over without any data loss, and if not, im just screwed again :P.

 

Pictures:

figured it was time for some pictures since this setup won't change any time soon, at least i hope not. So here goes, hopefully they're not to big :P

 

 

IMG_0996.JPG

IMG_1002.JPG

newserversetup.png


I have no signature

Link to post
Share on other sites

Hardware #1

Dell R710

PSU: 2x 870w Dell redundant

CPU: 2x Intel x5670

RAM: 64GB DDR3 1333

RAID CARD 1:  SAS9260-8I

SSD: Crucial 240g

HDD: 6x 3TB Toshiba P300

 

Software and Configuration:

Running Windows Server 2012 R2 off the SSD.  Drives are in RAID 5

Usage:

All it does right now is serve plex media and general storage.  I have WSUS set up on it as well but haven't done any client side configuration. Might start imaging my systems with Achronis and will be serving a host program for book keeping for the family business.

Additional info:

I'm setting up WSUS and a cacheing proxy (on the other server) so that I can have lan parties here, when I go to my friends on the weekend I have to update my laptop so I don't touch his data cap, all OS and game updates which can take quite a while esp if I want to bring a second laptop for my friend.  Often times I just don't go because I don't want to spend an hour in the morning downloading updates, and that means no spontaneous lan event's at his house.  I'm going to get a business connection at a much slower speed but static ip, higher upload, and no data cap.  So the WSUS and cacheing server will be important.

 

Hardware #2

Dell R510

PSU: 2x 750w Dell redundant

CPU: Intel x5650

RAM: 32GB DDR3 1333

RAID CARD 1:  Dell PERC H700 512mb w/battery

HDD: 12x 1TB Dell Enterprise class sataII (will crack it open for a better stat)

 

Software and Configuration:

esxi.  Drives are RAID 50 with 2 parity drives.  I will get a second x5650 and heatsink down the road

Usage:

It's a VM Server right now, two instances of Ubuntu. This one is the cacheing server

Additional info:

I don't have the proxy running completely as I'm confused how to start it up again after a reboot.  I saw an article on docker compose, however it's been over a decade since using Linux and as always, trying to learn one thing means you have to learn 10 other thing's.  I'm not in a hurry though.  My setup is temporary while I wait for the time and energy to finish my basement, I'm thinking I will get a 4 post 15u open rack mount and put everything under my stairs.

Photo's:

I will get better pic's but it's night time now

 

 

20180828_134818.jpg

Link to post
Share on other sites
Posted · Original PosterOP

guess I should update, currently on 292TB raw, (45x4TB + 14x8TB)


Respect the Code of Conduct!

>> Feel free to join the unofficial LTT teamspeak 3 server TS3.schnitzel.team <<

>>LTT 10TB+ Topic<< | >>FlexRAID Tutorial<<>>LTT Speed wave<< | >>LTT Communies and Servers<<

Link to post
Share on other sites

I have 2 servers, both 8 bay 64tb raw data, however I have them in raidz2 leaving me with 48tb  useable 

Name: NAS4FREE (im rubbish with names so default pc name will do) 

Nas4free.PNG.c604de68343162c15cb9c3e467387117.PNG

PCPartPicker part list

CPU: Intel - Celeron G3930 2.9GHz Dual-Core Processor
Motherboard: ASRock - C236 WSI Mini ITX LGA1151 Motherboard  
Memory: Crucial - Ballistix Sport LT 16GB (1 x 16GB) DDR4-2666 Memory 
Storage: Seagate - Archive 8TB 3.5" 5900RPM Internal Hard Drive 
Storage: Seagate - Archive 8TB 3.5" 5900RPM Internal Hard Drive  
Storage: Seagate - Archive 8TB 3.5" 5900RPM Internal Hard Drive  
Storage: Seagate - Archive 8TB 3.5" 5900RPM Internal Hard Drive 
Storage: Seagate - Archive 8TB 3.5" 5900RPM Internal Hard Drive  
Storage: Seagate - Archive 8TB 3.5" 5900RPM Internal Hard Drive  
Storage: Seagate - Archive 8TB 3.5" 5900RPM Internal Hard Drive  
Storage: Toshiba - N300 8TB 3.5" 7200RPM Internal Hard Drive 
Case: Silverstone - DS380B Mini ITX Tower Case  
Power Supply: be quiet! - POWER 2 400W 80+ Bronze Certified SFX Power Supply 
Generated by PCPartPicker 2018-10-13 08:42 BST+0100

 

Second System: NAS4FREE-White (once again default system name expect the case is white so I know which one:D )

Nas4freewhite.PNG.82cad9b16fcc76d78641df24c9645620.PNG

PCPartPicker part list

CPU: Intel - Core i3-4130 3.4GHz Dual-Core Processor 
CPU Cooler: Cooler Master - Hyper 212 EVO 82.9 CFM Sleeve Bearing CPU Cooler   
Motherboard: ASRock - C226WS ATX LGA1150 Motherboard 
Memory: Corsair - Vengeance LP 32GB (4 x 8GB) DDR3-1866 Memory  
Storage: Toshiba - N300 8TB 3.5" 7200RPM Internal Hard Drive  
Storage: Toshiba - N300 8TB 3.5" 7200RPM Internal Hard Drive  
Storage: Toshiba - N300 8TB 3.5" 7200RPM Internal Hard Drive   
Storage: Toshiba - N300 8TB 3.5" 7200RPM Internal Hard Drive   
Storage: Toshiba - N300 8TB 3.5" 7200RPM Internal Hard Drive   
Storage: Toshiba - N300 8TB 3.5" 7200RPM Internal Hard Drive   
Storage: Toshiba - N300 8TB 3.5" 7200RPM Internal Hard Drive   
Storage: Toshiba - N300 8TB 3.5" 7200RPM Internal Hard Drive   
Case: NZXT - Source 210 Elite (Black) ATX Mid Tower Case 
Power Supply: be quiet! - Pure Power 10 400W 80+ Silver Certified ATX Power Supply 
Generated by PCPartPicker 2018-10-13 08:44 BST+0100

 

USAGE: 

 

NASFREE holds my backup data, documents etc.

Both contain back of games, my various system backups etc. but mostly media. 

 

Pictures:

 

 

 

20181013_090544.thumb.jpg.b4fe1750e04ec765b8c00e235ca0478a.jpg

Network drives.PNG

20181013_090557.jpg

Link to post
Share on other sites

Great to see all that server equipment in this thread. Got me thinking I'd want some kind of 19" rack to put my ampifiers and audio equipment in. So I went and searched the local marketplace and found this €25 thing. Put my DCX2496 crossovers in there for test fitting:

sRTCynR9TREzalsPDHhgzhoVGt4OpBRBA694jRwl

 

Needs some cleaning and I don't like how far back the gear sits so I have mounted the front rails more to the front. Also, that way the amplifiers would fit better (but still have to cut some holes in the back)

 

XyIAuTl_ShbHOV1u_zLrUuKxY3QJRcIeJpwsgDAv

Here it shows how far back the equipment would have been. Also didn't like the dated look of the blue stripes.

6AysSVULGiZf9AyPKYoyitdM6qgZ2uym8rngHEEy

Modified.... It still needs cleaning and test fitting of the (large) amps, cutouts in the back and I think I will add some fans on the top

Elbw15yEyexrdloixjv3Ubofz5KNAqWK8DPtc21I

Because it seems it would be an easy mod to add fans. Metric units for scale.

 

When I arrived at the location to pickup the cabinet, the guy also told me he had another rack, but bigger. It wasn't up for sale yet and he didn't know what he was selling so I got a €75,- deal for a 19" server rack, a KVM console, 2U ATX server chassis with rails and a 4U ATX server chassis with rails.

 

eff0C51UBq5RyV9J-PnSo_cGaFg-WzZxzBgtS__y

Boy this thing was dirty...

 

ZjyU6Q9FqgqwNqWeC9W90aOALW_jScjl1dZg8Q5-

It has an optional top fan thingy with the (original) thermoswitch. I'm sure it isn't supposed to be mounted that way so I removed it and cleaned it up...

 

ESdHHfeREJ26UoSEKi2lg_-xROxpjusw_tyTDtdX

That's way better... Thermoswitch thing has been removed and the fans are now directly attached to the big red switch.

 

ZKjc6c3eObD5eMPWY2wLyEvMIQYR4iQ1ytC7K06p

Cleaning the monster's guts...

In the back you can see how basically the whole thing looked when I first got it.

HlXkAbSZLosif6UGo63Lj827eyYRcTMbH8m6G4SP

The filth... But happy to clean it as it was basically free. A while ago I was searching for these things (I found a KVM switch in the trash so I thought it would be nice to have a console for my servers) and they seem to be expensive, even the old ones. It still works which is very nice.

 

PPE581XC01i4O9gPsv70zZQsorEIU-TY4rHpMDVw

Here I installed the KVM switch on top, and the 4U server chassis I got with it. Don't know if I'm going to keep it in the rack (because ugly af).

Previous owner jerry-rigged some sound absorption panels in the side panels, in a way the panels have to be pushed in with force. Because of this, the plastic latches of the side panels ALL broke :'((((. I am going to fix these in the future and show how it's done.

 

Now for the stuff that's going in the racks:

dSqkmqX4e_TL2_7Av43CPLSFqz40yjGXVqcdthtP

4x Dell Poweredge 2950 II & III (Specs are being upgraded) (2 found in trash, 2 bought for €100)

3x Dell PowerVault MD1000 (14-bay 3,5" SAS/SATA DAS enclosures) Currently 1 is equipped with 8x1, 4x2 and 1x4TB disks. Other two are empty. I can get the 4TB disks for €25,- so I'm going to test if these disks are compatible with the supposedly max 2TB MD1000's. I have seen reports of users having larger disks to fingers crossed.

 

Amplifiers are going in the glass-doored rack, which will become my TV-stand in the home theater room I'm building. I've build some subwoofers to go with the home theater:

yRqy97-EuZXJEaRcZi9XOHVoMPBhjqkzqYrhTXH5

They need some type of finishing though.

 

2x 24port switches are already mounted in the server rack.

But now the best part of today's activities: I found another add online... Oh noes, even more stuff. Where am I going to keep it?

This time: all this lot for €300:

jF3s00Iis0UQ1FR_zWr8QapWtBfdd14JlJ-SpGPd

Everything except the farthest 2 pallets on the right.

The stack of servers in the middle (the 4 metal colored ones) are Isilon 72NL servers. 4 of them. That's 288TB of storage?!?

These are supposed to have 36 drives each, 2TB per drive.

Pray for me these enclosures are not emptied out...

When will we find out? Approximately 14 hours from now. I'll keep you posted. 

 

--EDIT--

Aaannddd FAIL. Empty cases. Still bought the lot, reselling to buy more hard drives.


No signature found

Link to post
Share on other sites
On 5/7/2018 at 6:05 PM, kiddsupreme said:

Hardware:
I had been wanting to add my name to list for a while now. I have the following:

 

  • HDD
    • 2 x 8TB Seagate ST8000AS0002
    • 2 x 4TB Seagate ST4000DM000
    • 1 x 8TB Seagate ST8000VN0002
      • (All drives utilizing ext4, NON-RAID, JBODs)
  • OS
    • Fedora 28 (64 bit of course)
      • ext4
      • Located on a Plextor 128GB SSD
  • Motherboard
    • ASRock Z77 Extreme4
  • Memory
    • 2 x 8GB G.Skill Memory (DDR3, 1600Mhz)
  • CPU
    • Intel Core i5-2320
  • Case
    • Corsair 900D

Usage

Multiple uses (File server, Plex Server, home to some VM's, etc)

 

Time to update the list:

 

  • HDD
    • 2 x 12TB Segate ST12000NM0007
    • 2 x 8TB Seagate ST8000DM0004
    • 2 x 8TB Seagate ST8000AS0002
    • 1 x 8TB Seagate ST8000VN0002
    • 1 x 4TB Seagate ST4000DM004
    • 1 x 3TB Western Digital WD30EZRX (I can't believe this guy is still running after nearly 8 years. Time to retire soon)
    • 1 x 500GB Samsung SSD 850 EVO
      • (All drives utilizing ext4, NON-RAID, JBODs)
  • OS
    • Fedora 29 (64 bit of course)
      • ext4
      • Located on a Samsung SSD 860 EVO 1TB SSD
  • Motherboard
    • ASRock Z77 Extreme4
  • Memory
    • 4 x 8GB (32GB Total) Corsair Vengeance Memory (DDR3, 1600Mhz)
  • CPU
    • Intel Xeon E3-1275 V2
  • Case
    • Corsair 900D

Usage

Multiple uses (File server, Plex Server, home to some VM's, etc)


RIG: CPU - Intel i7-4790K | CPU Cooler - Corsair H110 | Motherboard - Asus MAXIMUS VII FORMULA | Memory - Corsair Dominator Platinum 32GB DDR3-2133 | Storage - Samsung 840 EVO 250GB SSD /1TB SSD / WD Caviar Black 2TB | Video Card - EVGA GeForce GTX 1080 TI FTW3 | Case - Corsair 750D | Power Supply - Corsair AX1200i | OS - Microsoft Windows 10 | Monitor - Asus PB278Q | Keyboard - K70 RGB MK.2 RAPIDFIRE CHERRY® MX Speed | Mouse - Logitech G502 | Optical Drive - Pioneer BDR-XD05 | Front Bay Controller - ASUS ROG Front Base Dual-Bay Gaming Panel | Fans - Noctua NF-A14 PWM | 

 

Link to post
Share on other sites

Hardware

CASE: Synology DS2415+

RAM: 6 GB RAM


HDD 1: 10x 10TB Seagate IronWolf ST10000VN0004

HDD 2: 2x 14 TB Seagate IronWolf ST14000VN0008

The RAID IS a SHR, Synology Hybrid Raid, with a capacity of 114 TB. Currently, I'm using about 104 of it.


Software and Configuration:

The NAS is running DSM 6.2.1-23824 Update 1


Usage:

I work for myself and use it for scraping and calculations. And the other 113 TB is for private stuff ?

 

Backup:

Backup? Yeah, the important stuff is backed up on a WD Elements 4TB external USB drive

 

Photo's: I hope this is homely enough for you ?

20181203_100452.jpg

20181203_100458.jpg

Link to post
Share on other sites
5 hours ago, Javaan said:

Hardware

CASE: Synology DS2415+

RAM: 6 GB RAM


HDD 1: 10x 10TB Seagate IronWolf ST10000VN0004

HDD 2: 2x 14 TB Seagate IronWolf ST14000VN0008

The RAID IS a SHR, Synology Hybrid Raid, with a capacity of 114 TB. Currently, I'm using about 104 of it.


Software and Configuration:

The NAS is running DSM 6.2.1-23824 Update 1


Usage:

I work for myself and use it for scraping and calculations. And the other 113 TB is for private stuff ?

 

Backup:

Backup? Yeah, the important stuff is backed up on a WD Elements 4TB external USB drive

 

Photo's: I hope this is homely enough for you 

 

<<SNIPP>>

The buckling of that top shelf pleases me, 114TB should weigh a lot lol. I don't think I've seen that much storage in a essentially a consumer synology before.

What are you using to scrape (and if so inclined, what are you scraping)?

Link to post
Share on other sites
2 hours ago, Mikensan said:

The buckling of that top shelf pleases me, 114TB should weigh a lot lol. I don't think I've seen that much storage in a essentially a consumer synology before.

What are you using to scrape (and if so inclined, what are you scraping)?

Well, I work on personalization concepts for ecommerce, in which all kinds of data on website usage and social network analysis is combined, and the second topic is logistics network optimization for retail. My two colleagues partially aldo store on it, . the core is backed up on a wd elements and cloud (which i forgot to mention)

Link to post
Share on other sites
2 hours ago, Javaan said:

Well, I work on personalization concepts for ecommerce, in which all kinds of data on website usage and social network analysis is combined, and the second topic is logistics network optimization for retail. My two colleagues partially aldo store on it, . the core is backed up on a wd elements and cloud (which i forgot to mention)

Ah ok makes sense with it all put together. Social meida scrapping and retail would seem to go hand in hand. I just learned about ArchiveTeam Warrior which seems pretty neat, so wasn't sure if you were doing something similar to that. I have only played with the scraping tools found in Kali, seemed interesting enough.

https://www.archiveteam.org/index.php?title=ArchiveTeam_Warrior

Link to post
Share on other sites

I'm going to spend some time in the next week or so to go through and updated everything again.  If you've gotten some sweet black friday deals it'd be a good time to get it all assembled!

Link to post
Share on other sites

Hardware:
CASE: coolmaster h500

PSU: seasonic gold 750watt

MB: Asus X99-E-10G WS

CPU: amd threadripper 1950

HS: Noctua NH tr4

RAM: gskil ddr 64gb

Network: intel 1gb

Boot Disk:wd m.2 6gb read ,write 500gb

SSD: 2 x 250GB Samsung 850 EVO,1 samsung  500gb ssd

HDD 1: 4tb

HDD 2: 2tb

hdd 3: 3tb

drobo 4 drive. connected to pc   had 3. but 2 drives went bad. so replace it with 2 smaller drives. archive system. atm

main file server is dead. took 4 drives with it. had 4tb on it.  5 of 8 stata ports where  full.

then i have 2 external 4tb drives. for the ah crap drive moment encase

just got 16 more tb. in the mail atm

Link to post
Share on other sites

Hardware:
Server: HP Proliant DL380G7 (FreeNAS running Plex Media Server and SMB shares)

PSU: 2x 460W redundant (balancing mode)

CPU: 2x Xeon X5660 (12 cores, 24 threads total)

RAM: 96 GB 1333Mhz (12x8GB)

Network: 4x1Gb onboard

Boot Disk: 2x 8GB Sata SSD (RAID1) running FreeNAS

Plex jail: 192GB (3x64GB HP SSD RAIDz)

The following hard disks are in 4x Dell MD1000 shelfs, connected to LSI HBA via SAS 6Gb/s 4x

HDD 1: 60TB (15x4TB 7200rpm SAS RAIDz)

HDD 2: 12TB (12x1TB 7200rpm SATA RAIDz)

HDD 3: 8TB (4x2TB 7200rpm SATA RAIDz)

HDD 4: 5.25TB (7x750GB 7200rpm SATA RAIDz)

HDD 5: 2.4TB (8x300GB 15000rpm SAS)

 

Hardware:
Server: HP Proliant DL580G5 (Just a downloading whore, I RDP into her a lot)

PSU: 4x 1200W redundant (balancing mode)

CPU: 4x Xeon 7330 (16 cores total)

RAM: 32GB 533Mhz (32x1GB lol)

Network: 2x1Gb onboard

Boot Disk: 2x 250GB 860 EVO (RAID0) running Windows Server 2019

HDD 1: 2TB (14x146GB 2.5" 15000 rpm SAS

 

Current plans are: buying another 45 4TB disks to put in the MD1000 shelfs. Sell the other disks.

I also have two HP shelfs that are empty right now that I want to put in the rack as well. That means I need to move the ethernet switch and the KVM switch to the back of the rack. Upgrade the Windows machine to 32x4GB=128GB RAM to increase the PrimoCache size, so I don't have to write to the SSD's as much. Re-do the wiring on the backside, installing a HP PDU, etc.

 


No signature found

Link to post
Share on other sites

Shutgun
Case
:

  • HP Pavillon Case
  • 5.25" to 4 x 3.5" SATA SAS HDD Cage Rack Hard Driver Tray Caddy with Fan (needed dome Dremel love to go in)

PSU:     EVGA 500B

MB:     ASUS P7N73-AM (4 x SATA 3Gb/s)
CPU:     Intel E8400 
Ram:     4gb DDR2
NIC:     Intel 82574 Gigabit

Boot Disk:  120 GO Maxtor PATA (system drive)

Data Disk:

  • 1 x 2TB Hitachi
  • 2 x 2TB Seagate
  • 1 x 3TB WDD

Volume(s): RAID 10 = 1 x 2TB Hitachi; 2 x 2TB Seagate and 1 x3TB WDD @ 2TB


Software:

  • Xubuntu 18.04.1
  • MDADM
  • Webmin  1.900
  • FSLint Janitor
  • Disk usage Analyser

Usage:
Storage only
This is a proof of concept ; I am looking to build the real server starting this month with 6 x 2tb 2½ sata data disk a and 1 x 250go m2 pcie 2x system disk with a 5.25" to 6 x 2.5" SATA SAS HDD Cage Rack Hard Driver Tray Caddy with Fan 
 
Backup:
Not yet
 
Photos:

20181226_112304.jpg

Capture d’écran_2018-12-26_11-55-06.png

composite-1.jpg

s-l1600.jpg

V Download.png

V Upload.png

webmin.png

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now


×