Data hoarder needs help

[Count_Nibbles]

Hi All, short time lurker first time poster. 

 

Curious to hear some ideas from the internet about this. 

 

For a long time I have been riding a motorcycle and I usually always have a helmet camera running to record the ride (In case of an accident or I see something worth uploading to youtube).

Now bearing in mind this is a 1080p camera (contour roam 2) I am filling up my hard drive pretty quickly. What I have been doing is uploading the footage to a 1TB HDD through a dock (normal PC hard drive) 

I am looking for something that I can store in a single volume perhaps up to 10 TB with a little redundancy I am sure some of the video have been duplicated but I have filled up at least 4 hard drives so far. 

 

Any thoughts on this from everyone? 

 

I have an old perspex PC case that I was thinking of turning into a "media server" its currently got a pentium 4 with a whopping 512mb ram and a 100gb hard drive (pata)

 

Thoughts?

[WereCatf]

3 minutes ago, Count_Nibbles said:

I am looking for something that I can store in a single volume perhaps up to 10 TB with a little redundancy I am sure some of the video have been duplicated but I have filled up at least 4 hard drives so far.

For close to 10TB-capacity with one-drive-redundancy, you'd need e.g. a 3-bay NAS filled with 4TB-drives, which would net you 8TB useable space in RAID5, or RAID1 with 4x4TB-drives would net you the same capacity, but could handle two drives failing. As for what hardware to use, I do not know, but I hear Synology's NAS-systems are supposed to be good.

[Ansger]

watch the Petabyte project vrom LTT on youtube and build one. Set for life.

[unijab]

If you build something over 10TB... dont forget to post it in the LTT Storage Rankings thread.

[Sir Asvald]

On 12/22/2017 at 2:34 PM, unijab said:

If you build something over 10TB... dont forget to post it in the LTT Storage Rankings thread.

Nevermind. I found it

[Swiip]

There are realy cheap proliant microserver g7 on ebay, they are not the fastest, but have 4 bays.

The bigger version would be something like a DL180 G6, but they are loud.

[ChristopherH]

I would recommend something like this is you are going to be running RAID5:

 

https://www.mwave.com.au/product/synology-ds918-4-bay-nas-4x-seagate-st4000vn008-4tb-ironwolf-nas-hdd-ac08440

 

Or this if you don't mind spending the extra ~$450 for RAID10 redundancy and the same storage spec:

 

https://www.mwave.com.au/product/synology-ds918-4-bay-nas-4x-seagate-st6000vn0041-6tb-ironwolf-nas-hdd-ac08443

 

We use Synology NAS units at work (have a RS2416RP+ in our server room at out office with an identical unit in a DC for offisite, both loaded with 3TB Seagate IronWolf Pro disks) and have never had an issue with it since they were both deployed.

[Mattias Edeslatt]

Just curios, why save the material where nothing happens? I can understand that you save for a limited time, and then delete if there is no need for it after a few weeks. Memorable jurneys/moments goes to a cold storage with a good labeling system for folders. Maybe even edited so you just save the as little as possible and makes it easy to remember why you saved it in the first place 

 

But it it's just an excuse to build a ginormous storage-server to rule the LTT storage ranking, then by all means, go ahead and I will eagerly await the pictures and spec-pr0n 

[Paul Vreeland]

As a technician, I have setup clients that process large volumes of photo or video data.  Sign shops, photo or video studios, etc.

 

ALL of them have some kind of pruning process during the intake.  It doesn't matter how much storage space you have, if you don't prune as you take it in, you will never watch it all or look through it all to find something useful later.

 

In the home environment, I like to refer to this effect as the "camera phone mom syndrome"  15,000 images, 10,000 are blurry.  Out of the 5,000 remaining, 1,000 are "oops" photos from the pocket or at the ceiling.  Out of the 4,000 left you get down to groups of 5-10 pictures of the same moment where none of them were pruned for the "best" one.  This is most commonly found among Mac users surprisingly, not bashing Mac users at all, just the truth.  Maybe more Mac folks are into "casual photography" more than others.

 

It is a discipline to review the data or even think before importing "is this worth storing?", but it will pay off ten-fold when you need to actually go into the archive.  There is no such thing as a storage space amount that won't fill up, there is no infinity storage.

 

Some successful pruning techniques:

• After the moment is fresh, review the data.  Not days or weeks later.
• Delete older than XX days
• Set a hard limit for how many images to keep (or clips of video)
• Yes, clip your video.  2 hours of video for 2 seconds of important stuff is wasteful.
• Share and review with friends or family, this will force pruning more often (holidays, events, etc)