Affordable Cloud GPUs for ML

[Jet_ski]

Does anyone know of an affordable cloud GPU provider for ML? Preferably one with Jupyter support. ~$150 per months would be ok.

 

I know about Google Colab's free and $9.99 per month plans but the platform is unusable. If I pause for a minute to change something, they take away the GPU. It wouldn't be a big deal if the platform reconnected automatically but it doesn't. I find it very disruptive.

[Kisai]

I'm not sure really. It looks like with all these cloud providers offering GPU's for ML it seems like nobody is asking what is a reasonable price is.

 

Like if I just want to goof around with stuff I found on the internet, I don't want to pay hundreds of dollars for potentially wasted time, but in the same breath I don't want to spend hundreds of dollars building some servers just to goof around with stuff either.

 

My suggestion, is if you do not yet have something that needs time, run it on your own device until you get the all the pieces you need that it can run indefinitely, then go to the cloud with it. If it's something that doesn't have urgency though, or doesn't scale to multiple GPU's just build a few Ubuntu boxes and run it on those. If a Titan/RTX 3090 or whatever else costs $1200+ that's as much as paying $100/mo for that GPU anyway.

[OddOod]

And see if you can snag a whale on a 2080ti on ebay rn, they're stupid cheap sometimes

[Jet_ski]

42 minutes ago, Kisai said:

My suggestion, is if you do not yet have something that needs time, run it on your own device until you get the all the pieces you need that it can run indefinitely, then go to the cloud with it. If it's something that doesn't have urgency though, or doesn't scale to multiple GPU's just build a few Ubuntu boxes and run it on those. If a Titan/RTX 3090 or whatever else costs $1200+ that's as much as paying $100/mo for that GPU anyway.

I agree, I just wanted to make sure there aren’t a bunch of lesser known cloud providers.

 

21 minutes ago, OddOod said:

And see if you can snag a whale on a 2080ti on ebay rn, they're stupid cheap sometimes

I haven’t seen any bargain so far. Right now the bids start at $300 and get really high, almost $650, the price of a new 3080. I might just try and order a 3080 or 3090.

[OddOod]

I think one big issue might be that if cloudGPUs were cheaper, people would mine with them

 

[Jet_ski]

On 9/12/2020 at 9:18 PM, OddOod said:

I think one big issue might be that if cloudGPUs were cheaper, people would mine with them

While it's possible to use cloud services for mining, there are a lot of ways they can prevent it from happening.

 

I think the prices are generally in line with the cost of providing the resources. The challenge is that an efficient on-demand allocation of the resources isn't possible for GPUs with the current tech. When you share a printer on a network, people send jobs to it and it queues them and goes through queue. With GPU and CPU it doesn't work that efficiently; I don't understand it exactly but there are other hoops to go through.