Server advice

[MJFlanigan]

I am learning to code and getting into data science and have been looking into building a powerful workstation or server like this: Deep Learning Workstations, Servers, Laptops for 2021 | Lambda

The main thing I'd like to do with a setup like this is to be able to not only run simulations but also run multiple machines or at least virtual machines for my house and also run high end programs with the hardware.

As I've been doing some research I've also seen things like the storinator (Storinator™ S45 - The Standard Direct-Wired Pod) and wondered if with a solution like that if I could use it to storage and edit video off of it but also record and analyze and playback security camera footage for my house. I know there are solutions for this, but I prefer less hardware and don't know how to start.

I'd media server and nas functionality as well.

Ideally I'd like to build one server that does this all but have no idea how to do that or where to start, but would love any direction anyone has or suggestions.

[Electronics Wizardy]

Whats your budget?

 

How much storage do you need? How fast do you plan on growing?
 

Id strongly suggest against having vms for all your systems. Having seperate workstations is much less hassle, esp when starting out.

[MJFlanigan]

I'm open on the budget and am fine not using virtual machines. I was looking at a chasis like this that could have maybe like 120 terabytes of storage: https://www.gigabyte.com/Enterprise/Rack-Server/R282-Z96-rev-A00#Specifications

[Electronics Wizardy]

1 minute ago, MJFlanigan said:

I'm open on the budget and am fine not using virtual machines. I was looking at a chasis like this that could have maybe like 120 terabytes of storage: https://www.gigabyte.com/Enterprise/Rack-Server/R282-Z96-rev-A00#Specifications

What gpus do you want to use? How much vram do you need?

 

What makes you want that server? there are lots of options for 12 bay 2u systems, and Id go dell/hp/lenovo as there normally much better built.

[MJFlanigan]

Gotcha do you have any recommendations on a particular chasis that is similar to the one I posted. I'd want up to 4 gpus and for vram I'd just like it to be enough for machine learning.

 

I want the server to not have multiple machines running around unless you think a workstation is better. I'm fine with either path but like the idea of being able to run stuff remotely over a network.

[Electronics Wizardy]

4 minutes ago, MJFlanigan said:

I'd just like it to be enough for machine learning.

How much is enought? How big are your models?

 

Id probably do some more learning before you buy any hardware.

 

 

4 minutes ago, MJFlanigan said:

I want the server to not have multiple machines running around unless you think a workstation is better. I'm fine with either path but like the idea of being able to run stuff remotely over a network.

What types of things do you want to run remotly? how much cpu power and ram do you need?

[MJFlanigan]

Do you have recommendations @Electronics Wizardyor do you jsut want to keep asking questions? I think I've answered a bunch of them and would really just like recommendations. 

[Electronics Wizardy]

1 minute ago, MJFlanigan said:

Do you have recommendations @Electronics Wizardyor do you jsut want to keep asking questions? I think I've answered a bunch of them and would really just like recommendations. 

Well its hard to make reccomdations without more details. 

 

Id really suggest you learn more so you can get more exact requirements. 

 

Do you have a rack for this server? Do you have the cooling and power. Many of these gpu servers won't run off a normal outlet. These are extremly loud too. Do you have a separate room for it?

 

What gpus do you plan on using? these are made for server gpus, not gtx/rtx cards, so those can be 10K+ per card. 

 

Id just get a high power workstations and put the storage and gpus in there. Good place to start, and get a server later if needed.

[MJFlanigan]

Thanks.