LTT Storage Rankings

[L.E.D]

Exactly. By default, the ZFS filesystem will use up to 7/8 of your system memory for caching. (I have a minecraft servers taking up the other few gigs)

 

Off topic but, Do you host MC servers for others ? Or just your own ?

[Eric1024]

Off topic but, Do you host MC servers for others ? Or just your own ?

Just for myself (I have a vanilla server for me and friends, a world edit server for me, and a vanilla server for my little sister and her friends). I suppose I have the horsepower to host a few servers for others but the logistics of that would be way too much of a pain in the ass for me.

[L.E.D]

Just for myself (I have a vanilla server for me and friends, a world edit server for me, and a vanilla server for my little sister and her friends). I suppose I have the horsepower to host a few servers for others but the logistics of that would be way too much of a pain in the ass for me.

 

Oh ok, I was hoping you would host one for me lol, I cannot under and circumstance host a any type of server with my ISP :(

[Eric1024]

Oh ok, I was hoping you would host one for me lol, I cannot under and circumstance host a any type of server with my ISP :(

Hmm, why not? Just not enough speed?

 

I'm leaving for college in literally 12 hours, and I have no idea weather or not I'll be able to host from there. I'll definitely have the speed but I have a feeling I won't be able to access the routers to set up port forwarding.

[L.E.D]

Hmm, why not? Just not enough speed?

 

I'm leaving for college in literally 12 hours, and I have no idea weather or not I'll be able to host from there. I'll definitely have the speed but I have a feeling I won't be able to access the routers to set up port forwarding.

 

Yeah, I don't think they would let you do that lol, I wish my ISP would lighten up about server, We have the speed for a server.... It is just their stupid policy, which I may be inclined to break....

 

Ohwell, Thanks for atleast thinking about doing this for me,

[Eric1024]

Yeah, I don't think they would let you do that lol, I wish my ISP would lighten up about server, We have the speed for a server.... It is just their stupid policy, which I may be inclined to break....

 

Ohwell, Thanks for atleast thinking about doing this for me,

Well all ISPs have that in their contracts :P The thing is that minecraft servers use so little bandwidth that your ISP would never notice that you were hosting a server. The only thing they could really do to stop you from hosting servers would be to change your IP address all the time, which you can still get around with services like dynDNS.

[looney]

Hardware

CASE: Fractal Design Define Mini

PSU: Corsair CX500M

MB: SUPERMICRO MBD-X9SCM-F-O LGA 1155

CPU: Intel Xeon E3-1220V2

HS: Noctua NH-L9i

RAM: 32GB (4 x 8 GB) DDR3 1600MHz ECC RAM

SATA Card: HighPoint Rocket 620

FANS: 2x Noctua NF-F12

HDD: 6x Seagate NAS HDD 4TB

SSD: Intel X25-v 40GB (L2ARC)

Very nice system indeed!

your added to the list with 24TB.

PS: what drives do you use?  << I'm tired, I need to sleep :p

[Eric1024]

PS: what drives do you use?

He has it in his parts list :P Seagates NAS drives, the ones that are basically WD reds but from seagate and up to 4TB in capacity.

[looney]

He has it in his parts list :P Seagates NAS drives, the ones that are basically WD reds but from seagate and up to 4TB in capacity.

lol, i really need some more sleep....

 

For some reason I only saw 6 x NAS HDD 4TB....

[Eric1024]

lol, i really need some more sleep....

 

For some reason I only saw 6 x NAS HDD 4TB....

Dude what time is it where you are?

[looney]

Dude what time is it where you are?

its not the time, just haven't had a lot of sleep lately. 

[Eric1024]

its not the time, just haven't had a lot of sleep lately. 

I know that feeling...

 

(boy we're off topic)

[tycheleto]

Another update with replacement drive that pushes it to 14TB total..

 

Hardware
CASE: Fractal Design Define Mini
PSU: Seasonic G-360
MB: MSI H77MA-G43
CPU: Intel Pentium G2020
HS: Stock Intel Heatsink
RAM: 8GB DDR3 1600
SSD: Corsair Force GT 60GB SSD
HDD 1: 1x 2TB Seagate Barracuda Green ST2000DL003
HDD 2: 3x 3TB WD Red WD30EFRX

HDD 3: 1x 3TB Seagate Barracuda 7200.14 ST3000DM001

 

Total HDD Capacity: 14 TB

Total Usable Capacity: 11 TB

 

Software and Configuration:
My server is running Windows 8 with FlexRAID Transparent Raid(tRaid) for pooling/array. 
The array currently has the one 2TB Seagate drive and two 3TB WD Red as data drives, with the last the 3TB WD Red as a parity drive (8TB Usable, 11TB Total). The 3TB Seagate is a last drive for downloads/misc files/backups for files I need access to even when array is unavailable.
 
Usage:

 

Home Server is used for mainly music and videos. Server runs Emit Free/Air Playit Server for access on Android/iOS, and runs Plex for videos, a few devices also use the server for iTunes Libraries. Most computers access the server via SMB with no software. The server also enables a centralized place for downloading programs/videos for everyone's access. 
It’s also for backing up my computers.
 
Backup:
Currently no backup of entire server. However, most data is replicated in at least one other location to prevent hardware failure from causing data loss.
 
Additional info:
Status as of Dec 2013: Server is still fairly unstable even after a few months of experimentation. First tried unRAID for a while, but write performance wasn’t sufficient. Moved to Real Time Raid for FlexRAID, but kept having errors, to the point I was recalculating my entire parity at least once every 2 or 3 days. Moved to tRAID to see if it improves stability, but still a work in progress as tRAID is still in the RC stage. Waiting for tRAID to reach full release before I finalize the software setup.

 

2014 April Update: Server has been very stable past few months, had a period where it stayed on for 48 days in a row. Transparent RAID is being continuously updated, so getting small performance increases every now and then. Just had a disk failure last week, which made me realize that I had my drive labels wrong, and had to reconfigure the entire array, but should be good now.

 

 

 

 
Photo's:

Edited April 12, 2014 by tycheleto

[looney]

Not yet 10TB+, but a work in progress and hopefully will hit 10TB+ by the end of the year.

getting very close though :P

nice system man!

[MG2R]

Additional info:

Server is still fairly unstable

Unstable in what way? Have you considered running some flavour of Linux?

[tycheleto]

getting very close though

nice system man!

Thanks!

 

Unstable in what way? Have you considered running some flavour of Linux?

Well, I've only been on tRaid for 4 or 5 days, and it's had no problems since I changed. But tRaid is still a beta release so I'm not 100% sure what it'll be like. Should only get better as it gets closer to full release though.

 

When I was on Realtime RAID, I had multiple occasions whereby my sharing permissions would get messed up, and I would be unable to write to the array at all(even from the server itself). Sometimes this just required going into permissions and changing some things back and forth to get them to work.

However, in most cases I would try to restart the storage pool to fix it, and it would refuse to stop the storage pool, then I would have no choice but to restart the computer. This would mess up the Parity, and force me to spend a few hours checking/recalculating the parity.

 

FlexRAID would also sometimes tell me that my Parity drive was full and I'd have to wipe the drive and redo the parity. Lastly, I had some issues caused by filling up one drive too fast, as I was doing an emergency backup of about 500GB of data from a failing hard drive in my main rig.

 

Hopefully most of these problems are fixed now.

[MG2R]

It seems weird that all these RAID solutions are giving you trouble. I don't know about all of them, but I'm fairly sure one particular member of this forum is willing to verify that FlexRAID is pretty damn reliable

 

One of the reasons I like linux so much for servers is that it's permission system is simple and straightforward. Unlike on windows, where you have to dig through countless windows to get to the permissions set for a specific directory, in Linux you just run ls -l /path/to/directory and you know everything you need to know. Setting up permissions is just as easy.

 

If solutions on Windows really keep giving you trouble and you would like to try Linux, just ask for help you could always read my Debian Home Server Howto (link in sig) to begin with, if you're interested.

 

If nothing gives a completely stable system, I'd start looking into hardware related issues (things like a faulty controller spring to mind).

[tycheleto]

Flexraid should be reliable, my problems seem fairly isolated. Anyway, traid should at least allow me to manage files better, and the downtime caused by parity errors is much less(can run while array is online).

As for linux, I was considering that at first, but bought windows 8 so I could try storage spaces if flexraid didn't work at all. Server does quite a lot of things(iTunes libraries, backups, BitTorrent, iTunes syncing for my phone, video streaming to mobile devices), so just seems easier for me to manage Windows which I am used to. I might be able to handle Linux but I doubt my father could do it if I was ever busy.

[BerryManaloaf]

This is all the sort of stuff I'm excited for for when I'm able to have an income. Right now I'm still in school and I'm stuck drooling over majority of what goes on here.

Very cool!

 

So jealous ...

[madcow]

Hardware
CASE: Chenbro RM42300
PSU: Seasonic X 400W
MB: Supermicro X9SCM
CPU: Xeon E3-1220
RAM: 16GB ECC
RAID CARD: IBM M1015 flashed to IT mode
SSD: Samsung 840 pro 256GB
HDD: 10x Seagate 4TB

Software and Configuration:
Running MDADM raid6 on Gentoo Linux with 32TB of usable space. VM and iSCSI boot images are on the SSD along with the host OS.

 

Usage:
This is my single point of failure unit for handling all things networking for the house

Host: NFS exports, BIND, DHCP, radius, iSCSI target, KVM

VM1: LAN to WAN routing, ddclient for afraid.org DDNS

VM2: VPN, LAN to VPN routing, web proxy, BIND slave

VM3: Icecast, wireless LAN controller (unifi), another web proxy

 

Backup:
Some data copied to a similar Chenbro build with 10x 3TB in MDADM raid6.
 
Photo's:

fs1 ~ # mdadm -D /dev/md0 /dev/md0:        Version : 1.2  Creation Time : Fri May 24 00:09:10 2013     Raid Level : raid6     Array Size : 31256123904 (29808.16 GiB 32006.27 GB)  Used Dev Size : 3907015488 (3726.02 GiB 4000.78 GB)   Raid Devices : 10  Total Devices : 10    Persistence : Superblock is persistent    Update Time : Sat Aug 24 14:01:18 2013          State : clean Active Devices : 10Working Devices : 10 Failed Devices : 0  Spare Devices : 0         Layout : left-symmetric     Chunk Size : 64K           Name : vm1:0           UUID : 5af1fdb6:01fa8c99:97c064ff:2659caeb         Events : 14887    Number   Major   Minor   RaidDevice State       0       8       81        0      active sync   /dev/sdf1       1       8      161        1      active sync   /dev/sdk1       2       8      113        2      active sync   /dev/sdh1       3       8       97        3      active sync   /dev/sdg1       4       8        1        4      active sync   /dev/sda1       5       8       49        5      active sync   /dev/sdd1       6       8      145        6      active sync   /dev/sdj1       7       8       65        7      active sync   /dev/sde1       8       8       33        8      active sync   /dev/sdc1       9       8       17        9      active sync   /dev/sdb1fs1 ~ # dd if=/dev/zero of=/store/backup/tmp.img bs=1M count=20000 conv=fdatasync20000+0 records in20000+0 records out20971520000 bytes (21 GB) copied, 21.4931 s, 976 MB/sfs1 ~ # dd if=/store/backup/tmp.img of=/dev/null bs=1M20000+0 records in20000+0 records out20971520000 bytes (21 GB) copied, 20.7837 s, 1.0 GB/s

 

Edit: Added pics of internals

[MG2R]

Usage:

This is my single point of failure unit for handling all things networking for the house

Host: NFS exports, BIND, DHCP, radius, iSCSI target, KVM

VM1: LAN to WAN routing, ddclient for afraid.org DDNS

VM2: VPN, LAN to VPN routing, web proxy, BIND slave

VM3: Icecast, wireless LAN controller (unifi), another web proxy

Nice to see someone with a dedicated DNS and DHCP host, that isn't done very often

[looney]

Hardware

CASE: Chenbro RM42300

PSU: Seasonic X 400W

MB: Supermicro X9SCM

CPU: Xeon E3-1220

RAM: 16GB ECC

RAID CARD: IBM M1015 flashed to IT mode

SSD: Samsung 840 pro 256GB

HDD: 10x Seagate 4TB

very nice system, ill add you to the list right away.

PS: could you also add a pic of the internals?

 

Nice to see someone with a dedicated DNS and DHCP host, that isn't done very often

Im also running those on my DL160G6 server

[RandomNOOB]

 

Hardware

CASE: Chenbro RM42300

PSU: Seasonic X 400W

MB: Supermicro X9SCM

CPU: Xeon E3-1220

RAM: 16GB ECC

RAID CARD: IBM M1015 flashed to IT mode

SSD: Samsung 840 pro 256GB

HDD: 10x Seagate 4TB

Software and Configuration:

Running MDADM raid6 on Gentoo Linux with 32TB of usable space. VM and iSCSI boot images are on the SSD along with the host OS.

 

 

Awww yeah! Linux power! Non of this Windows BS! : D

Are you running 2 of the 4TB drives of the MBs 6Gb/s ports?

 

I'd also like to see some internal pictures : )

[madcow]

Nice to see someone with a dedicated DNS and DHCP host, that isn't done very often

No way am I going to memorize IPs of each machine . All of the VMs and little things start to add up.

 

very nice system, ill add you to the list right away.

PS: could you also add a pic of the internals?

 

Im also running those on my DL160G6 server

Thanks. Adding to post when I get a chance.

 

Awww yeah! Linux power! Non of this Windows BS! : D

Are you running 2 of the 4TB drives of the MBs 6Gb/s ports?

 

I'd also like to see some internal pictures : )

Yeah. All Linux network

 

Actually the motherboard 6Gbps ports connect to the two 2.5" HDD bays on the front. I just have one SSD in there now but can hot swap in another.

 

The M1050 controller supports 6Gbps though so the 8 HDDs on the controller are on 6Gbps. Two remanining HDDs are on the motherboard 3Gbps.

[MG2R]

No way am I going to memorize IPs of each machine . All of the VMs and little things start to add up.

I assume you're running bind as a local DNS cahce as well?