Jump to content

Huge cloud storage required!

SharonX

Does the method used in this video still work please I need to upload a big data base asap :') 

Screenshot_20200105_173953_com.google.android.youtube.jpg

Link to comment
Share on other sites

Link to post
Share on other sites

8 minutes ago, SharonX said:

Does the method used in this video still work please I need to upload a big data base asap :') 

Screenshot_20200105_173953_com.google.android.youtube.jpg

How big of data base?

Internet Connection

My Rig: AMD Ryzen 9 3900X @ 4.3Ghz | Asus Prime X470-Pro | Corsair Vengeance RGB Pro 32 GB (4 x 8GB) DDR-4 3000Mhz OC'd @ 3400Mhz 16-20-20-38 |

EVGA RTX 2070 8GB XC Gaming OC @ 2145Mhz Boosted/ 1925Mhz Memory | WD SN750 500GB M.2 NVME | Gigabye 240GB SSD | 
XSPC EX 360mm | Corsair XC7 RGB CPU WB | EK-Vector RTX 2080 | Alphacool Eisbecher D5 150mm Plexi | XSPC Fittings | XSPC FLX Clear 7/16" ID, 5/8" OD |
Corsair LL120 x6 | Corsair RM750x White 2018 | Corsair Commander Pro | Corsair Obsidian 500D RGB SE | Corsair RGB LED Lighting PRO Expansion |
Corsair Strafe RGB MK.2 | Corsair Ironclaw RGB Wireless 18,000DPI | Acer 32" 4K 60Hz HDR600 Cert. ET322QK CBMIIPZX |

Passmark Score

3dmark Score

PC Parts Picker Link to Build

Network

Netgear LBR20 LTE Router | Verizon Unlimited Prepaid Hotspot Plan

HP 2530-48G-PoEP Switch

Rasberry Pi 4 Running Pihole

Linksys Velop 3 Mesh Wifi AP's

 

Link to comment
Share on other sites

Link to post
Share on other sites

Just now, ddennis002 said:

How big of data base?

Lets say 200 Tb database 

Link to comment
Share on other sites

Link to post
Share on other sites

2 minutes ago, SharonX said:

Lets say 200 Tb database 

it still has the same 750gb per day, and other limits, but seems to still work.

Link to comment
Share on other sites

Link to post
Share on other sites

Just now, SharonX said:

Lets say 200 Tb database 

Do you just need to upload it temp? Or long term backup?

Internet Connection

My Rig: AMD Ryzen 9 3900X @ 4.3Ghz | Asus Prime X470-Pro | Corsair Vengeance RGB Pro 32 GB (4 x 8GB) DDR-4 3000Mhz OC'd @ 3400Mhz 16-20-20-38 |

EVGA RTX 2070 8GB XC Gaming OC @ 2145Mhz Boosted/ 1925Mhz Memory | WD SN750 500GB M.2 NVME | Gigabye 240GB SSD | 
XSPC EX 360mm | Corsair XC7 RGB CPU WB | EK-Vector RTX 2080 | Alphacool Eisbecher D5 150mm Plexi | XSPC Fittings | XSPC FLX Clear 7/16" ID, 5/8" OD |
Corsair LL120 x6 | Corsair RM750x White 2018 | Corsair Commander Pro | Corsair Obsidian 500D RGB SE | Corsair RGB LED Lighting PRO Expansion |
Corsair Strafe RGB MK.2 | Corsair Ironclaw RGB Wireless 18,000DPI | Acer 32" 4K 60Hz HDR600 Cert. ET322QK CBMIIPZX |

Passmark Score

3dmark Score

PC Parts Picker Link to Build

Network

Netgear LBR20 LTE Router | Verizon Unlimited Prepaid Hotspot Plan

HP 2530-48G-PoEP Switch

Rasberry Pi 4 Running Pihole

Linksys Velop 3 Mesh Wifi AP's

 

Link to comment
Share on other sites

Link to post
Share on other sites

Best option for legitimately large cloud storage would probably be Backblaze B2. I use it for storing TBs of recorded footage and the pricing is very reasonable 

The Daily Driver:
AMD Ryzen 7 3700x  |  EVGA GTX 1070 SC  |  48GB Crucial Ballistix Elite DDR4-3600  | Corsair 750D Case
AsRock X570 Pro 4 mobo

iRacing Sim Rig:

i5-10600k @ 5.0 GHz  |  EVGA GTX 1080ti Hybrid  | 32GB G.Skill Trident Z Neo DDR4-3600  |  Corsair Air 540 Case
ASUS Z490-E ROG Strix mobo

Link to comment
Share on other sites

Link to post
Share on other sites

I think I remember Linus saying on a WAN show they had to give up on that pretty quickly. Don't remember the reasons.

F@H
Desktop: i9-13900K, ASUS Z790-E, 64GB DDR5-6000 CL36, RTX3080, 2TB MP600 Pro XT, 2TB SX8200Pro, 2x16TB Ironwolf RAID0, Corsair HX1200, Antec Vortex 360 AIO, Thermaltake Versa H25 TG, Samsung 4K curved 49" TV, 23" secondary, Mountain Everest Max

Mobile SFF rig: i9-9900K, Noctua NH-L9i, Asrock Z390 Phantom ITX-AC, 32GB, GTX1070, 2x1TB SX8200Pro RAID0, 2x5TB 2.5" HDD RAID0, Athena 500W Flex (Noctua fan), Custom 4.7l 3D printed case

 

Asus Zenbook UM325UA, Ryzen 7 5700u, 16GB, 1TB, OLED

 

GPD Win 2

Link to comment
Share on other sites

Link to post
Share on other sites

6 minutes ago, Electronics Wizardy said:

it still has the same 750gb per day, and other limits, but seems to still work.

I can do the 6 users thing to max it out

Link to comment
Share on other sites

Link to post
Share on other sites

1 minute ago, Kilrah said:

I think I remember Linus saying on a WAN show they had to give up on that pretty quickly. Don't remember the reasons.

Big œuf

Link to comment
Share on other sites

Link to post
Share on other sites

7 minutes ago, ddennis002 said:

Do you just need to upload it temp? Or long term backup?

Long term

Link to comment
Share on other sites

Link to post
Share on other sites

2 minutes ago, Kilrah said:

I think I remember Linus saying on a WAN show they had to give up on that pretty quickly. Don't remember the reasons.

I remember that too. I don't exactly remember the reason either, but I believe it had something to do with downgrading the upload speed to very very low or having an actual maximum cap.

PC SPECS: CPU: Intel Core i7 3770k @4.4GHz - Mobo: Asrock Extreme 4 (Z77) - GPU: MSI GeForce GTX 680 Twin Frozr 2GB - RAM: Crucial Ballistix 2x4GB (8GB) 1600MHz CL8 + 1x8GB - Storage: SSD: Sandisk Extreme II 120GB. HDD: Seagate Barracuda 1TB - PSU: be quiet! Pure Power L8 630W semi modular  - Case: Corsair Obsidian 450D  - OS: Windows 7

Link to comment
Share on other sites

Link to post
Share on other sites

5 minutes ago, vukos said:

Best option for legitimately large cloud storage would probably be Backblaze B2. I use it for storing TBs of recorded footage and the pricing is very reasonable 

I live in TUNISIA. Long story short ALL TYPES OF E-PAYMENT are banned no international cc, no paypal because of the miserable economic state. 

Link to comment
Share on other sites

Link to post
Share on other sites

So unless you can find a local company you're probably shafted...

Is Amazon there? Would take 4 of their snowballs to load such a big DB into AWS...

 

 

F@H
Desktop: i9-13900K, ASUS Z790-E, 64GB DDR5-6000 CL36, RTX3080, 2TB MP600 Pro XT, 2TB SX8200Pro, 2x16TB Ironwolf RAID0, Corsair HX1200, Antec Vortex 360 AIO, Thermaltake Versa H25 TG, Samsung 4K curved 49" TV, 23" secondary, Mountain Everest Max

Mobile SFF rig: i9-9900K, Noctua NH-L9i, Asrock Z390 Phantom ITX-AC, 32GB, GTX1070, 2x1TB SX8200Pro RAID0, 2x5TB 2.5" HDD RAID0, Athena 500W Flex (Noctua fan), Custom 4.7l 3D printed case

 

Asus Zenbook UM325UA, Ryzen 7 5700u, 16GB, 1TB, OLED

 

GPD Win 2

Link to comment
Share on other sites

Link to post
Share on other sites

i think they upped the transfer speeds since that video if that helps

PC: Alienware 15 R3  Cpu: 7700hq  GPu : 1070 OC   Display: 1080p IPS Gsync panel 60hz  Storage: 970 evo 250 gb / 970 evo plus 500gb

Audio: Sennheiser HD 6xx  DAC: Schiit Modi 3E Amp: Schiit Magni Heresy

Link to comment
Share on other sites

Link to post
Share on other sites

6 minutes ago, SharonX said:

Long term

I would check this out, I did the trial and was storing 16TB of data until I got my NAS up and running.

 

https://www.crashplan.com/en-us/business/compare/

Internet Connection

My Rig: AMD Ryzen 9 3900X @ 4.3Ghz | Asus Prime X470-Pro | Corsair Vengeance RGB Pro 32 GB (4 x 8GB) DDR-4 3000Mhz OC'd @ 3400Mhz 16-20-20-38 |

EVGA RTX 2070 8GB XC Gaming OC @ 2145Mhz Boosted/ 1925Mhz Memory | WD SN750 500GB M.2 NVME | Gigabye 240GB SSD | 
XSPC EX 360mm | Corsair XC7 RGB CPU WB | EK-Vector RTX 2080 | Alphacool Eisbecher D5 150mm Plexi | XSPC Fittings | XSPC FLX Clear 7/16" ID, 5/8" OD |
Corsair LL120 x6 | Corsair RM750x White 2018 | Corsair Commander Pro | Corsair Obsidian 500D RGB SE | Corsair RGB LED Lighting PRO Expansion |
Corsair Strafe RGB MK.2 | Corsair Ironclaw RGB Wireless 18,000DPI | Acer 32" 4K 60Hz HDR600 Cert. ET322QK CBMIIPZX |

Passmark Score

3dmark Score

PC Parts Picker Link to Build

Network

Netgear LBR20 LTE Router | Verizon Unlimited Prepaid Hotspot Plan

HP 2530-48G-PoEP Switch

Rasberry Pi 4 Running Pihole

Linksys Velop 3 Mesh Wifi AP's

 

Link to comment
Share on other sites

Link to post
Share on other sites

Just now, Kilrah said:

So unless you can find a local company you're probably shafted...

Is Amazon there? Would take 4 of their snowballs to load such a big DB into AWS...

Nah Homie it is a desert down here even the HDD I use for my server I got from europe ( I went to europe for 1 day bought the drives then went back) 

Link to comment
Share on other sites

Link to post
Share on other sites

Is this a backup or actually production?

F@H
Desktop: i9-13900K, ASUS Z790-E, 64GB DDR5-6000 CL36, RTX3080, 2TB MP600 Pro XT, 2TB SX8200Pro, 2x16TB Ironwolf RAID0, Corsair HX1200, Antec Vortex 360 AIO, Thermaltake Versa H25 TG, Samsung 4K curved 49" TV, 23" secondary, Mountain Everest Max

Mobile SFF rig: i9-9900K, Noctua NH-L9i, Asrock Z390 Phantom ITX-AC, 32GB, GTX1070, 2x1TB SX8200Pro RAID0, 2x5TB 2.5" HDD RAID0, Athena 500W Flex (Noctua fan), Custom 4.7l 3D printed case

 

Asus Zenbook UM325UA, Ryzen 7 5700u, 16GB, 1TB, OLED

 

GPD Win 2

Link to comment
Share on other sites

Link to post
Share on other sites

Just now, Kilrah said:

Is this a backup or actually production?

I didn't quite get the question but I have a 240 TB server and I am starting to get worried about losing my data so I am looking for a backup plan

Link to comment
Share on other sites

Link to post
Share on other sites

OK, when you meant "database" it seemed like a business application with the expected budgets. So just backup of your personal stuff.

 

How's internet connectivity from your place?

 

 

F@H
Desktop: i9-13900K, ASUS Z790-E, 64GB DDR5-6000 CL36, RTX3080, 2TB MP600 Pro XT, 2TB SX8200Pro, 2x16TB Ironwolf RAID0, Corsair HX1200, Antec Vortex 360 AIO, Thermaltake Versa H25 TG, Samsung 4K curved 49" TV, 23" secondary, Mountain Everest Max

Mobile SFF rig: i9-9900K, Noctua NH-L9i, Asrock Z390 Phantom ITX-AC, 32GB, GTX1070, 2x1TB SX8200Pro RAID0, 2x5TB 2.5" HDD RAID0, Athena 500W Flex (Noctua fan), Custom 4.7l 3D printed case

 

Asus Zenbook UM325UA, Ryzen 7 5700u, 16GB, 1TB, OLED

 

GPD Win 2

Link to comment
Share on other sites

Link to post
Share on other sites

3 minutes ago, Kilrah said:

OK, when you meant "database" it seemed like a business application with the expected budgets. So just backup of your personal stuff.

 

How's internet connectivity from your place?

 

 

 

FB_IMG_1578257407671.jpg

Link to comment
Share on other sites

Link to post
Share on other sites

9 minutes ago, SharonX said:

 

FB_IMG_1578257407671.jpg

You might as well forget about 200TB over a 43Mbps upload speed it would take over a year to upload that amount of data. Even if you had symetrical 1 gigbit fiber you be looking at around 20 days non stop upload to do that amount of data. 

Internet Connection

My Rig: AMD Ryzen 9 3900X @ 4.3Ghz | Asus Prime X470-Pro | Corsair Vengeance RGB Pro 32 GB (4 x 8GB) DDR-4 3000Mhz OC'd @ 3400Mhz 16-20-20-38 |

EVGA RTX 2070 8GB XC Gaming OC @ 2145Mhz Boosted/ 1925Mhz Memory | WD SN750 500GB M.2 NVME | Gigabye 240GB SSD | 
XSPC EX 360mm | Corsair XC7 RGB CPU WB | EK-Vector RTX 2080 | Alphacool Eisbecher D5 150mm Plexi | XSPC Fittings | XSPC FLX Clear 7/16" ID, 5/8" OD |
Corsair LL120 x6 | Corsair RM750x White 2018 | Corsair Commander Pro | Corsair Obsidian 500D RGB SE | Corsair RGB LED Lighting PRO Expansion |
Corsair Strafe RGB MK.2 | Corsair Ironclaw RGB Wireless 18,000DPI | Acer 32" 4K 60Hz HDR600 Cert. ET322QK CBMIIPZX |

Passmark Score

3dmark Score

PC Parts Picker Link to Build

Network

Netgear LBR20 LTE Router | Verizon Unlimited Prepaid Hotspot Plan

HP 2530-48G-PoEP Switch

Rasberry Pi 4 Running Pihole

Linksys Velop 3 Mesh Wifi AP's

 

Link to comment
Share on other sites

Link to post
Share on other sites

Yup.

Given the conditions your only solution will likely to buy enough storage to have your own local backup.

F@H
Desktop: i9-13900K, ASUS Z790-E, 64GB DDR5-6000 CL36, RTX3080, 2TB MP600 Pro XT, 2TB SX8200Pro, 2x16TB Ironwolf RAID0, Corsair HX1200, Antec Vortex 360 AIO, Thermaltake Versa H25 TG, Samsung 4K curved 49" TV, 23" secondary, Mountain Everest Max

Mobile SFF rig: i9-9900K, Noctua NH-L9i, Asrock Z390 Phantom ITX-AC, 32GB, GTX1070, 2x1TB SX8200Pro RAID0, 2x5TB 2.5" HDD RAID0, Athena 500W Flex (Noctua fan), Custom 4.7l 3D printed case

 

Asus Zenbook UM325UA, Ryzen 7 5700u, 16GB, 1TB, OLED

 

GPD Win 2

Link to comment
Share on other sites

Link to post
Share on other sites

38 minutes ago, ddennis002 said:

I would check this out, I did the trial and was storing 16TB of data until I got my NAS up and running.

 

https://www.crashplan.com/en-us/business/compare/

You do NOT want to use Crashplan. The GUI is obtuse, uploads range for slow to, often, no happening for a day or more at a time, their tech "help" needs to got back to school and take courses in geology and anatomy so they can tell their backsides from ahole in the ground, and your data is subject to being corrupted or lost. I tried their small business plan a while back and it was the most miserable backup experience and the biggest waste of money I ever encountered.

 

Your best and least expensive bet would be to get a duplicate server to clone your existing server onto, then store it offsite somewhere safe. Or simply copy your data onto individual HDDs and store them offsite. Reliable cloud backups for that much data will cost you more than the NGP of Tunisia (and most other smaller countries) and you could die of old age just getting the upload done and trying to recover from it.

 

Edit: I should have mentioned I have measly 20TB of storage (five 4TB SSDs), 14TB of which is actually

 and I'm using around 8-9TB of it. I backup each of those drives to internal type SSDs (I use hot swap bays in the computer to access them for updating and recovery). It's a whole lot less hassle than using a dulicate server, costs less, and takes up far less room than trying to store a duplicate server offsite.

 

Btw, I'm not saying keeping data on a server is a bad thing--there are perfectly valid reasons for it, such as allowing multiple computers to access the same data, etc. It's just easier and to not use one to backup data offsite.

Jeannie

 

As long as anyone is oppressed, no one will be safe and free.

One has to be proactive, not reactive, to ensure the safety of one's data so backup your data! And RAID is NOT a backup!

 

Link to comment
Share on other sites

Link to post
Share on other sites

Try EBS from amazon, maybe glacier is for you, if the info is not accesible often (let said 06 month)  it can be very cheap, or a combination between bucket + Glacier.

 

Link to comment
Share on other sites

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

×