Rest of the components for a 3090 rig for ML inference

[alparius]

Budget: max 2500 EUR/USD

Country: Germany 

Usage: ML inference calculations only

Other details: 

 

So I need to spec out a PC that will only be used for Machine Learning inference calculations. The requirements are simple: an RTX 3090 (Ti if budget will allow it) is fixed, but otherwise we only need some 6core recent-ish CPU and barely any RAM.

 

These are two builds that I clicked together using my passive knowledge from being a long-time LTT-viewer:

- https://de.pcpartpicker.com/user/alparius/saved/#view=2xr8Q7

- https://de.pcpartpicker.com/user/alparius/saved/#view=jbvGJx

 

So I think the GPU, CPU, RAM, SSD should be fine. I would like to ask your opinion about the rest: motherboard, CPU cooler, PSU and case. Are these good choices, are they compatible? Where could I spend less and should I spend more anywhere (except lttstore.com gotcha)? 

[igormp]

20 minutes ago, alparius said:

Budget: max 2500 EUR/USD

Country: Germany 

Usage: ML inference calculations only

Other details: 

 

So I need to spec out a PC that will only be used for Machine Learning inference calculations. The requirements are simple: an RTX 3090 (Ti if budget will allow it) is fixed, but otherwise we only need some 6core recent-ish CPU and barely any RAM.

 

These are two builds that I clicked together using my passive knowledge from being a long-time LTT-viewer:

- https://de.pcpartpicker.com/user/alparius/saved/#view=2xr8Q7

- https://de.pcpartpicker.com/user/alparius/saved/#view=jbvGJx

 

So I think the GPU, CPU, RAM, SSD should be fine. I would like to ask your opinion about the rest: motherboard, CPU cooler, PSU and case. Are these good choices, are they compatible? Where could I spend less and should I spend more anywhere (except lttstore.com gotcha)? 

You could try to go even cheaper with a ryzen 3600 and b450/a520 mobo.

 

Cooler, psu and case lgtm.

[Somerandomtechyboi]

https://de.pcpartpicker.com/list/rNBjLs

¯\_ (ツ) _/¯ 

 

Gpu wise theres tons of ebay 3090 with some going ~800$ or even ones going <800$, retarded to go new gpu when used gives a massive discount

[alparius]

On 9/23/2022 at 3:51 AM, igormp said:

You could try to go even cheaper with a ryzen 3600 and b450/a520 mobo.

 

Cooler, psu and case lgtm.

Sorry for the late reply, and thanks!

On 9/23/2022 at 6:12 AM, Somerandomtechyboi said:

https://de.pcpartpicker.com/list/rNBjLs

¯\_ (ツ) _/¯ 

 

Gpu wise theres tons of ebay 3090 with some going ~800$ or even ones going <800$, retarded to go new gpu when used gives a massive discount

While I can appreciate calling someone retarded on the spot, its not a big stretch to imagine that such a specific PC is required by an institute where funding is not as simple as "take this 2 grand and go haggle with some guys".

[brob]

There are a number of good cpu coolers with performance similar to the NH-D15, Deepcool AK620 and AK-500, and Thermalrite Peerless Assassin 120 SE to name a few.

 

DDR4-3200 CL16 has very similar performance to DDR4-3600 CL18 and typically better pricing.

 

Given that the motherboard is mATX, consider an mATX case.

 

The PSU is SFX and requires an adapter plate if used in an ATX PSU case.

 

Some suggestions:

 

PCPartPicker Part List

CPU: Intel Core i5-12600K 3.7 GHz 10-Core Processor  (€330.99 @ Mindfactory) 
CPU Cooler: Thermalright Peerless Assasin 120 SE 66.17 CFM CPU Cooler 
Motherboard: MSI PRO B660M-A WIFI DDR4 Micro ATX LGA1700 Motherboard  (€160.72 @ Amazon Deutschland) 
Memory: TEAMGROUP T-Force Vulcan Z 32 GB (2 x 16 GB) DDR4-3200 CL16 Memory  (€109.89 @ Alternate) 
Storage: TEAMGROUP MP33 PRO 1 TB M.2-2280 PCIe 3.0 X4 NVME Solid State Drive  (€79.78 @ Amazon Deutschland) 
Video Card: Asus TUF GAMING OC GeForce RTX 3090 Ti 24 GB Video Card  (€1299.90 @ Amazon Deutschland) 
Case: Asus Prime AP201 MicroATX Mini Tower Case  (€100.90 @ Alza) 
Power Supply: Phanteks AMP 850 W 80+ Gold Certified Fully Modular ATX Power Supply  (€137.89 @ Caseking) 
Case Fan: ARCTIC P12 56.3 CFM 120 mm Fan  (€4.99 @ Aquatuning) 
Case Fan: ARCTIC P12 56.3 CFM 120 mm Fan  (€4.99 @ Aquatuning) 
Total: €2230.05
Prices include shipping, taxes, and discounts when available
Generated by PCPartPicker 2022-10-12 18:39 CEST+0200

[igormp]

5 minutes ago, brob said:

There are a number of good cpu coolers with performance similar to the NH-D15, Deepcool AK620 and AK-500, and Thermalrite Peerless Assassin 120 SE to name a few.

 

DDR4-3200 CL16 has very similar performance to DDR4-3600 CL18 and typically better pricing.

 

Given that the motherboard is mATX, consider an mATX case.

 

The PSU is SFX and requires an adapter plate if used in an ATX PSU case.

 

Some suggestions:

 

PCPartPicker Part List

CPU: Intel Core i5-12600K 3.7 GHz 10-Core Processor  (€330.99 @ Mindfactory) 
CPU Cooler: Thermalright Peerless Assasin 120 SE 66.17 CFM CPU Cooler 
Motherboard: MSI PRO B660M-A WIFI DDR4 Micro ATX LGA1700 Motherboard  (€160.72 @ Amazon Deutschland) 
Memory: TEAMGROUP T-Force Vulcan Z 32 GB (2 x 16 GB) DDR4-3200 CL16 Memory  (€109.89 @ Alternate) 
Storage: TEAMGROUP MP33 PRO 1 TB M.2-2280 PCIe 3.0 X4 NVME Solid State Drive  (€79.78 @ Amazon Deutschland) 
Video Card: Asus TUF GAMING OC GeForce RTX 3090 Ti 24 GB Video Card  (€1299.90 @ Amazon Deutschland) 
Case: Asus Prime AP201 MicroATX Mini Tower Case  (€100.90 @ Alza) 
Power Supply: Phanteks AMP 850 W 80+ Gold Certified Fully Modular ATX Power Supply  (€137.89 @ Caseking) 
Case Fan: ARCTIC P12 56.3 CFM 120 mm Fan  (€4.99 @ Aquatuning) 
Case Fan: ARCTIC P12 56.3 CFM 120 mm Fan  (€4.99 @ Aquatuning) 
Total: €2230.05
Prices include shipping, taxes, and discounts when available
Generated by PCPartPicker 2022-10-12 18:39 CEST+0200

Why not go for a 12400(F) and cheaper mobo? This would also save on the cooler, since OP mentioned that CPU isn't that important, most of the work being done here is for the GPU when doing the inferences.

[Somerandomtechyboi]

2 hours ago, alparius said:

While I can appreciate calling someone retarded on the spot, its not a big stretch to imagine that such a specific PC is required by an institute where funding is not as simple as "take this 2 grand and go haggle with some guys".

Yea i think i had a brainfart when i wrote that

 

Also the 4090 exists and it trounces the 3090 so you should prob go for that instead. And if you cant buy used then find the best value new parts

[brob]

24 minutes ago, igormp said:

Why not go for a 12400(F) and cheaper mobo? This would also save on the cooler, since OP mentioned that CPU isn't that important, most of the work being done here is for the GPU when doing the inferences.

 

I wouldn't go for a less expensive motherboard. Choice of CPU really depends on user needs. Budget permitting I think having more cpu resources and performance than needed is not a problem while the opposite is. In fact, if budget allowed I'd be inclined to opt for an i7-12700.

[igormp]

8 minutes ago, brob said:

I wouldn't go for a less expensive motherboard.

Why? Any budget mobo should be able to run a 12400 without issues.

8 minutes ago, brob said:

Choice of CPU really depends on user needs.

And they made it clear it's not that important, for ML the CPU is pretty much irrelevant.

[brob]

9 minutes ago, igormp said:

Why? Any budget mobo should be able to run a 12400 without issues

 

Don't forget the RTX 3090. It also places demands on the motherboard.

 

[igormp]

23 minutes ago, brob said:

 

Don't forget the RTX 3090. It also places demands on the motherboard.

 

How so? As long as you have a PCIe x16 slot (won't even matter if 3.0 or 4.0 tbh) it should be more than enough, and basically all available mobos have that.