Jump to content
Search In
  • More options...
Find results that contain...
Find results in...
SharonX

Huge cloud storage required!

Recommended Posts

Posted · Original PosterOP

Does the method used in this video still work please I need to upload a big data base asap :') 

Screenshot_20200105_173953_com.google.android.youtube.jpg

Link to post
Share on other sites
8 minutes ago, SharonX said:

Does the method used in this video still work please I need to upload a big data base asap :') 

Screenshot_20200105_173953_com.google.android.youtube.jpg

How big of data base?


Internet Connection

My Rig: AMD Ryzen 7 2700X @ 4.2Ghz | Asus Prime X470-Pro | Corsair Vengeance RGB Pro 32 GB (4 x 8GB) DDR-4 3000Mhz OC'd @ 3400Mhz 16-20-20-38 |

EVGA RTX 2070 8GB XC Gaming OC @ 2145Mhz Boosted/ 1925Mhz Memory | WD SN750 500GB M.2 NVME | Gigabye 240GB SSD | WD Purple 8TB |
XSPC EX 360mm | XSPC Raystorm V3 | EK-Vector RTX 2080 | Alphacool Eisbecher D5 150mm Plexi | XSPC Fittings | XSPC FLX Clear 7/16" ID, 5/8" OD |
Corsair LL120 x6 | Corsair RM750x White 2018 | Corsair Commander Pro | Corsair Obsidian 500D RGB SE | Corsair RGB LED Lighting PRO Expansion |
Corsair Strafe RGB MK.2 | Corsair Harpoon RGB Wireless 10,000DPI | LG 27" 4K 60Hz 27UK650 |

Passmark Score

3dmark Score

PC Parts Picker Link to Build

 

Link to post
Share on other sites
Just now, SharonX said:

Lets say 200 Tb database 

Do you just need to upload it temp? Or long term backup?


Internet Connection

My Rig: AMD Ryzen 7 2700X @ 4.2Ghz | Asus Prime X470-Pro | Corsair Vengeance RGB Pro 32 GB (4 x 8GB) DDR-4 3000Mhz OC'd @ 3400Mhz 16-20-20-38 |

EVGA RTX 2070 8GB XC Gaming OC @ 2145Mhz Boosted/ 1925Mhz Memory | WD SN750 500GB M.2 NVME | Gigabye 240GB SSD | WD Purple 8TB |
XSPC EX 360mm | XSPC Raystorm V3 | EK-Vector RTX 2080 | Alphacool Eisbecher D5 150mm Plexi | XSPC Fittings | XSPC FLX Clear 7/16" ID, 5/8" OD |
Corsair LL120 x6 | Corsair RM750x White 2018 | Corsair Commander Pro | Corsair Obsidian 500D RGB SE | Corsair RGB LED Lighting PRO Expansion |
Corsair Strafe RGB MK.2 | Corsair Harpoon RGB Wireless 10,000DPI | LG 27" 4K 60Hz 27UK650 |

Passmark Score

3dmark Score

PC Parts Picker Link to Build

 

Link to post
Share on other sites

Best option for legitimately large cloud storage would probably be Backblaze B2. I use it for storing TBs of recorded footage and the pricing is very reasonable 


The Daily Driver:
AMD Ryzen 7 3700x  |  EVGA GTX 1080 ti Hybrid  |  32GB Crucial Ballistix Elite DDR4-3600  |  Corsair Air 540 case

Link to post
Share on other sites

I think I remember Linus saying on a WAN show they had to give up on that pretty quickly. Don't remember the reasons.


Desktop: i7-5960X 4.4GHz, Noctua NH-D14, ASUS Rampage V, 32GB, RTX2080S, 2TB NVMe SSD, 2x16TB HDD RAID0, Corsair HX1200, Thermaltake Overseer RX1, Samsung 4K curved 49" TV, 23" secondary

Mobile SFF rig: i9-9900K, Noctua NH-L9i, Asrock Z390 Phantom ITX-AC, 32GB, GTX1070, 2x1TB NVMe SSD RAID0, 2x5TB 2.5" HDD RAID0, Athena 500W Flex (Noctua fan), Custom 4.7l 3D printed case

Dell XPS 2 in 1 2019, 32GB, 1TB, 4K / GPD Win 2

Link to post
Share on other sites
Posted · Original PosterOP
6 minutes ago, Electronics Wizardy said:

it still has the same 750gb per day, and other limits, but seems to still work.

I can do the 6 users thing to max it out

Link to post
Share on other sites
Posted · Original PosterOP
1 minute ago, Kilrah said:

I think I remember Linus saying on a WAN show they had to give up on that pretty quickly. Don't remember the reasons.

Big œuf

Link to post
Share on other sites
Posted · Original PosterOP
7 minutes ago, ddennis002 said:

Do you just need to upload it temp? Or long term backup?

Long term

Link to post
Share on other sites
2 minutes ago, Kilrah said:

I think I remember Linus saying on a WAN show they had to give up on that pretty quickly. Don't remember the reasons.

I remember that too. I don't exactly remember the reason either, but I believe it had something to do with downgrading the upload speed to very very low or having an actual maximum cap.


PC SPECS: CPU: Intel Core i7 3770k @4.4GHz - Mobo: Asrock Extreme 4 (Z77) - GPU: MSI GeForce GTX 680 Twin Frozr 2GB - RAM: Crucial Ballistix 2x4GB (8GB) 1600MHz CL8 + 1x8GB - Storage: SSD: Sandisk Extreme II 120GB. HDD: Seagate Barracuda 1TB - PSU: be quiet! Pure Power L8 630W semi modular  - Case: Corsair Obsidian 450D  - OS: Windows 7

Link to post
Share on other sites
Posted · Original PosterOP
5 minutes ago, vukos said:

Best option for legitimately large cloud storage would probably be Backblaze B2. I use it for storing TBs of recorded footage and the pricing is very reasonable 

I live in TUNISIA. Long story short ALL TYPES OF E-PAYMENT are banned no international cc, no paypal because of the miserable economic state. 

Link to post
Share on other sites

So unless you can find a local company you're probably shafted...

Is Amazon there? Would take 4 of their snowballs to load such a big DB into AWS...

 

 


Desktop: i7-5960X 4.4GHz, Noctua NH-D14, ASUS Rampage V, 32GB, RTX2080S, 2TB NVMe SSD, 2x16TB HDD RAID0, Corsair HX1200, Thermaltake Overseer RX1, Samsung 4K curved 49" TV, 23" secondary

Mobile SFF rig: i9-9900K, Noctua NH-L9i, Asrock Z390 Phantom ITX-AC, 32GB, GTX1070, 2x1TB NVMe SSD RAID0, 2x5TB 2.5" HDD RAID0, Athena 500W Flex (Noctua fan), Custom 4.7l 3D printed case

Dell XPS 2 in 1 2019, 32GB, 1TB, 4K / GPD Win 2

Link to post
Share on other sites

i think they upped the transfer speeds since that video if that helps


PC: Alienware 15 R3  Cpu: 7700hq  GPu : 1070 OC   Display: 1080p IPS Gsync panel 60hz  Storage: 970 evo 250 gb / 970 evo plus 500gb 

Link to post
Share on other sites
6 minutes ago, SharonX said:

Long term

I would check this out, I did the trial and was storing 16TB of data until I got my NAS up and running.

 

https://www.crashplan.com/en-us/business/compare/


Internet Connection

My Rig: AMD Ryzen 7 2700X @ 4.2Ghz | Asus Prime X470-Pro | Corsair Vengeance RGB Pro 32 GB (4 x 8GB) DDR-4 3000Mhz OC'd @ 3400Mhz 16-20-20-38 |

EVGA RTX 2070 8GB XC Gaming OC @ 2145Mhz Boosted/ 1925Mhz Memory | WD SN750 500GB M.2 NVME | Gigabye 240GB SSD | WD Purple 8TB |
XSPC EX 360mm | XSPC Raystorm V3 | EK-Vector RTX 2080 | Alphacool Eisbecher D5 150mm Plexi | XSPC Fittings | XSPC FLX Clear 7/16" ID, 5/8" OD |
Corsair LL120 x6 | Corsair RM750x White 2018 | Corsair Commander Pro | Corsair Obsidian 500D RGB SE | Corsair RGB LED Lighting PRO Expansion |
Corsair Strafe RGB MK.2 | Corsair Harpoon RGB Wireless 10,000DPI | LG 27" 4K 60Hz 27UK650 |

Passmark Score

3dmark Score

PC Parts Picker Link to Build

 

Link to post
Share on other sites
Posted · Original PosterOP
Just now, Kilrah said:

So unless you can find a local company you're probably shafted...

Is Amazon there? Would take 4 of their snowballs to load such a big DB into AWS...

Nah Homie it is a desert down here even the HDD I use for my server I got from europe ( I went to europe for 1 day bought the drives then went back) 

Link to post
Share on other sites

Is this a backup or actually production?


Desktop: i7-5960X 4.4GHz, Noctua NH-D14, ASUS Rampage V, 32GB, RTX2080S, 2TB NVMe SSD, 2x16TB HDD RAID0, Corsair HX1200, Thermaltake Overseer RX1, Samsung 4K curved 49" TV, 23" secondary

Mobile SFF rig: i9-9900K, Noctua NH-L9i, Asrock Z390 Phantom ITX-AC, 32GB, GTX1070, 2x1TB NVMe SSD RAID0, 2x5TB 2.5" HDD RAID0, Athena 500W Flex (Noctua fan), Custom 4.7l 3D printed case

Dell XPS 2 in 1 2019, 32GB, 1TB, 4K / GPD Win 2

Link to post
Share on other sites
Posted · Original PosterOP
Just now, Kilrah said:

Is this a backup or actually production?

I didn't quite get the question but I have a 240 TB server and I am starting to get worried about losing my data so I am looking for a backup plan

Link to post
Share on other sites

OK, when you meant "database" it seemed like a business application with the expected budgets. So just backup of your personal stuff.

 

How's internet connectivity from your place?

 

 


Desktop: i7-5960X 4.4GHz, Noctua NH-D14, ASUS Rampage V, 32GB, RTX2080S, 2TB NVMe SSD, 2x16TB HDD RAID0, Corsair HX1200, Thermaltake Overseer RX1, Samsung 4K curved 49" TV, 23" secondary

Mobile SFF rig: i9-9900K, Noctua NH-L9i, Asrock Z390 Phantom ITX-AC, 32GB, GTX1070, 2x1TB NVMe SSD RAID0, 2x5TB 2.5" HDD RAID0, Athena 500W Flex (Noctua fan), Custom 4.7l 3D printed case

Dell XPS 2 in 1 2019, 32GB, 1TB, 4K / GPD Win 2

Link to post
Share on other sites
Posted · Original PosterOP
3 minutes ago, Kilrah said:

OK, when you meant "database" it seemed like a business application with the expected budgets. So just backup of your personal stuff.

 

How's internet connectivity from your place?

 

 

 

FB_IMG_1578257407671.jpg

Link to post
Share on other sites
9 minutes ago, SharonX said:

 

FB_IMG_1578257407671.jpg

You might as well forget about 200TB over a 43Mbps upload speed it would take over a year to upload that amount of data. Even if you had symetrical 1 gigbit fiber you be looking at around 20 days non stop upload to do that amount of data. 


Internet Connection

My Rig: AMD Ryzen 7 2700X @ 4.2Ghz | Asus Prime X470-Pro | Corsair Vengeance RGB Pro 32 GB (4 x 8GB) DDR-4 3000Mhz OC'd @ 3400Mhz 16-20-20-38 |

EVGA RTX 2070 8GB XC Gaming OC @ 2145Mhz Boosted/ 1925Mhz Memory | WD SN750 500GB M.2 NVME | Gigabye 240GB SSD | WD Purple 8TB |
XSPC EX 360mm | XSPC Raystorm V3 | EK-Vector RTX 2080 | Alphacool Eisbecher D5 150mm Plexi | XSPC Fittings | XSPC FLX Clear 7/16" ID, 5/8" OD |
Corsair LL120 x6 | Corsair RM750x White 2018 | Corsair Commander Pro | Corsair Obsidian 500D RGB SE | Corsair RGB LED Lighting PRO Expansion |
Corsair Strafe RGB MK.2 | Corsair Harpoon RGB Wireless 10,000DPI | LG 27" 4K 60Hz 27UK650 |

Passmark Score

3dmark Score

PC Parts Picker Link to Build

 

Link to post
Share on other sites

Yup.

Given the conditions your only solution will likely to buy enough storage to have your own local backup.


Desktop: i7-5960X 4.4GHz, Noctua NH-D14, ASUS Rampage V, 32GB, RTX2080S, 2TB NVMe SSD, 2x16TB HDD RAID0, Corsair HX1200, Thermaltake Overseer RX1, Samsung 4K curved 49" TV, 23" secondary

Mobile SFF rig: i9-9900K, Noctua NH-L9i, Asrock Z390 Phantom ITX-AC, 32GB, GTX1070, 2x1TB NVMe SSD RAID0, 2x5TB 2.5" HDD RAID0, Athena 500W Flex (Noctua fan), Custom 4.7l 3D printed case

Dell XPS 2 in 1 2019, 32GB, 1TB, 4K / GPD Win 2

Link to post
Share on other sites
38 minutes ago, ddennis002 said:

I would check this out, I did the trial and was storing 16TB of data until I got my NAS up and running.

 

https://www.crashplan.com/en-us/business/compare/

You do NOT want to use Crashplan. The GUI is obtuse, uploads range for slow to, often, no happening for a day or more at a time, their tech "help" needs to got back to school and take courses in geology and anatomy so they can tell their backsides from ahole in the ground, and your data is subject to being corrupted or lost. I tried their small business plan a while back and it was the most miserable backup experience and the biggest waste of money I ever encountered.

 

Your best and least expensive bet would be to get a duplicate server to clone your existing server onto, then store it offsite somewhere safe. Or simply copy your data onto individual HDDs and store them offsite. Reliable cloud backups for that much data will cost you more than the NGP of Tunisia (and most other smaller countries) and you could die of old age just getting the upload done and trying to recover from it.

 

Edit: I should have mentioned I have measly 20TB of storage (five 4TB SSDs), 14TB of which is actually

 and I'm using around 8-9TB of it. I backup each of those drives to internal type SSDs (I use hot swap bays in the computer to access them for updating and recovery). It's a whole lot less hassle than using a dulicate server, costs less, and takes up far less room than trying to store a duplicate server offsite.

 

Btw, I'm not saying keeping data on a server is a bad thing--there are perfectly valid reasons for it, such as allowing multiple computers to access the same data, etc. It's just easier and to not use one to backup data offsite.


Jeannie

 

As long as anyone is oppressed, no one will be safe and free.

One has to be proactive, not reactive, to ensure the safety of one's data so backup your data! And RAID is NOT a backup!

 

Link to post
Share on other sites

Try EBS from amazon, maybe glacier is for you, if the info is not accesible often (let said 06 month)  it can be very cheap, or a combination between bucket + Glacier.

 

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now


×