Machine Learning Server Build

[Zephyrus_47]

Hi good day, 
My team is working on some neural network modeling for use in the medical sector. However some of the datasets we are working with are between 10 - 30 GB of data.
We are running into some resource complications, having to truncate our data. Google Colab isn't a solution as we are outside the US and can't use Colab Pro. At the moment we can use a machine provided by a professor at our university, however this can only be used for some hours on some days. (i9-9900k, 64GB RAM, Nvidia RTX Titan). Even with this setup some data processing jobs takes 6-10 hours and even more.

We are interested in building a Server to run JupyterHub for our use. 

I would like some recommendations on what would you all recommend for the CPU and the amount of RAM as we regularly hit the caps on both.

As well as, some advice on how to ask companies if they are willing to sponsor some components to help further our contributions to the research field.

 

Thanking you in advance for your time and help.

 

[Electronics Wizardy]

Do you have a budget in mind? 

 

What about formfactor? Rack or tower? Does noise matter? Power?

 

How much ram do you want? 

 

Do you need more vram? 

 

That gpu is about as fast as you can get now, so you probably want multiple gpus, you can fit about 3-4 in a tower, mor than that you need a rack case.

[Zephyrus_47]

Budget will depend mainly on how much sponsors we can get ($3000 USD) excluding cost of GPU.

 

Form factor, doesn't matter, server preferred  but tower can be used as well. Power is not an issue, what ever psu is needed to run it we will have to get it.

 

RAM, 64 GB min depending on budget. 128 GB preferred (maybe even more if budget allows)

 

No more VRAM is needed, titan should be fine. Maybe later on if we do need more we will do the multiple. Atm it is bottle necked by the CPU and RAM mainly

 

 

[Electronics Wizardy]

Just now, Zephyrus_47 said:

Budget will depend mainly on how much sponsors we can get ($3000 USD) excluding cost of GPU.

 

Form factor, doesn't matter, server preferred  but tower can be used as well. Power is not an issue, what ever psu is needed to run it we will have to get it.

 

RAM, 64 GB min depending on budget. 128 GB preferred (maybe even more if budget allows)

 

No more VRAM is needed, titan should be fine. Maybe later on if we do need more we will do the multiple. Atm it is bottle necked by the CPU and RAM mainly

 

 

Best bet is probably get a used gpu server. Hunt on ebay for then. You can find some with dual 2011-3 cpus for under that price, then add gpus.

[Zephyrus_47]

Thanks, but will that be faster than an i9-9900k?

[Electronics Wizardy]

Just now, Zephyrus_47 said:

Thanks, but will that be faster than an i9-9900k?

If you can use all the cores, easily. You can get dual 22 cores for those systems.

[Zephyrus_47]

2 minutes ago, Electronics Wizardy said:

If you can use all the cores, easily. You can get dual 22 cores for those systems.

Thanks for the advice!