$5000 Build for Dev / Personal Work

[gmob]

1. Budget & Location

$5000 USD. Location US
 

2. Aim

Primarily my own work, software dev, ML/AI dev/prototyping and hosting a local server for ML inferencing with potential for GPU expansion.

Side aim: I sold my PC when I moved states in 2020 and have had a linux/Mac since then, now that I’ve finally decided to get a powerhouse, might as well game on it.

Also any comments / suggestions on Nvidia drivers (for gamer cards) on windows vs linux on speed and performance? 

 

3. Monitors

Minimum 2 - I have two 4k monitors at the moment.

 - Possibly 3/4.

 

4. Peripherals

Not needed.

 

5. Why are you upgrading?

I have an M1 Pro where I do most of my work. I need a workstation that I can keep running in the background for training / inferencing while I can still work on the non ML related stuff. 

 

Been watching LTT for years now, shame on me, I haven’t learnt anything. Need help with what kind of memory I should be using and which boards are compatible with my asks.

 

1. Would consider increasing my budget if I can get my hands on an A100 40G, but I don't think that's going to be possible anytime soon without paying outrageous prices and/or getting scammed.

2. I currently have a CalDigital TH4 Element Hub that connects all my monitors and peripherals resulting in a single cable that plugs into my laptop. I'm mostly planning to ssh into the pc and run stuff, but would like the option of just plugging in the cable into the pc when I need to for either gaming or anything that cant be done through ssh, I feel like this might be tricky without a kvm for the keyboard / mouse.

3. Maybe some subtle RGB, don't want to be spending too much on the RGB stuff but a PC without RGB would feel a bit soulless. 

[gmob]

Wondering if i should go with a pre-built system instead

https://www.ibuypower.com/store/rdy-element-hybrid-max-iii

iBUYPOWER HYTE Y60 RGB Gaming Case - Black

Intel® Core™ i9-14900KF CPU

64GB DDR5-6000 Kingston RGB RAM

MSI GeForce RTX 4090 SUPRIM LIQUID - 24GB

2TB Samsung M.2 GEN4 NVMe SSD

ASUS ROG STRIX Z790-E WiFi MB

[Jon-Slow]

 I would probably ask this question in a community of AI/ML folks that actually do the work you do. They might be able to better guide you towards what parts would be the best use for your money. I wouldn't recommend a prebuilt, and you might not need a 14900KF for what specific purpose you want to use it for. Your usecase might benefit from a cheap processor next to 2 4090s instead, or 2 used 3090s for cheaper. You should probably seek guidance from the type of experts that do exactly what you do, that would probably be a lot more helpful. 

[Why_Me]

https://www.pugetsystems.com/  

 

 

[brob]

3 hours ago, gmob said:

Wondering if i should go with a pre-built system instead

https://www.ibuypower.com/store/rdy-element-hybrid-max-iii

iBUYPOWER HYTE Y60 RGB Gaming Case - Black

Intel® Core™ i9-14900KF CPU

64GB DDR5-6000 Kingston RGB RAM

MSI GeForce RTX 4090 SUPRIM LIQUID - 24GB

2TB Samsung M.2 GEN4 NVMe SSD

ASUS ROG STRIX Z790-E WiFi MB

 

If you want to be able to add GPU a Threadripper system is likely the better choice.

 

[Linuswasright]

If you want a Threadripper, these guys are great for a ton of fast af threads. You’ll also get much better value than prebuilt. But it’s worse for iogradeablilty. 

 

PCPartPicker Part List: https://pcpartpicker.com/list/DqnN7R

CPU: AMD Threadripper 3970X 3.7 GHz 32-Core Processor  ($1770.99 @ Amazon) 
CPU Cooler: Corsair iCUE H150i ELITE CAPELLIX XT 65.57 CFM Liquid CPU Cooler  ($180.63 @ Amazon) 
Motherboard: Gigabyte TRX40 AORUS MASTER EATX sTRX4 Motherboard  ($599.99 @ Amazon) 
Memory: Patriot Viper 4 Blackout 64 GB (2 x 32 GB) DDR4-3600 CL18 Memory  ($114.99 @ Newegg) 
Storage: Leven JPS800 2 TB M.2-2280 PCIe 4.0 X4 NVME Solid State Drive  ($99.99 @ Amazon) 
Storage: Seagate ST6000NM0024 6 TB 3.5" 7200 RPM Internal Hard Drive  ($79.98 @ Amazon) 
Video Card: PNY XLR8 Gaming VERTO EPIC-X RGB OC GeForce RTX 4090 24 GB Video Card  ($1669.99 @ GameStop) 
Case: Montech AIR 903 MAX ATX Mid Tower Case  ($69.98 @ Amazon) 
Power Supply: be quiet! Straight Power 12 1500 W 80+ Platinum Certified Fully Modular ATX Power Supply  ($249.90 @ Amazon) 
Total: $4836.44
Prices include shipping, taxes, and discounts when available
Generated by PCPartPicker 2024-03-21 07:51 EDT-0400

Here’s a more traditional one; Since you’re a software dev I’m assuming you want strong multicore performance and good mt.
 

PCPartPicker Part List: https://pcpartpicker.com/list/bPqwn6

CPU: Intel Core i9-14900K 3.2 GHz 24-Core Processor  ($539.99 @ Newegg) 
CPU Cooler: Corsair iCUE H150i ELITE CAPELLIX XT 65.57 CFM Liquid CPU Cooler  ($180.63 @ Amazon) 
Motherboard: ASRock Z790 Pro RS ATX LGA1700 Motherboard  ($169.99 @ Newegg) 
Memory: Mushkin Redline ST 64 GB (2 x 32 GB) DDR5-6400 CL32 Memory  ($179.99 @ Newegg) 
Storage: Leven JPS800 2 TB M.2-2280 PCIe 4.0 X4 NVME Solid State Drive  ($99.99 @ Amazon) 
Storage: Seagate ST6000NM0024 6 TB 3.5" 7200 RPM Internal Hard Drive  ($79.98 @ Amazon) 
Video Card: PNY XLR8 Gaming VERTO EPIC-X RGB OC GeForce RTX 4090 24 GB Video Card  ($1669.99 @ GameStop) 
Case: Montech AIR 903 MAX ATX Mid Tower Case  ($69.98 @ Amazon) 
Power Supply: Gigabyte UD1000GM 1000 W 80+ Gold Certified Fully Modular ATX Power Supply  ($119.99 @ Amazon) 
Total: $3110.53
Prices include shipping, taxes, and discounts when available
Generated by PCPartPicker 2024-03-21 07:55 EDT-0400

[gmob]

12 hours ago, brob said:

 

If you want to be able to add GPU a Threadripper system is likely the better choice.

 

Yes I think you're right about that.

11 hours ago, Linuswasright said:

If you want a Threadripper, these guys are great for a ton of fast af threads. You’ll also get much better value than prebuilt. But it’s worse for iogradeablilty. 

 

PCPartPicker Part List: https://pcpartpicker.com/list/DqnN7R

CPU: AMD Threadripper 3970X 3.7 GHz 32-Core Processor  ($1770.99 @ Amazon) 
CPU Cooler: Corsair iCUE H150i ELITE CAPELLIX XT 65.57 CFM Liquid CPU Cooler  ($180.63 @ Amazon) 
Motherboard: Gigabyte TRX40 AORUS MASTER EATX sTRX4 Motherboard  ($599.99 @ Amazon) 
Memory: Patriot Viper 4 Blackout 64 GB (2 x 32 GB) DDR4-3600 CL18 Memory  ($114.99 @ Newegg) 
Storage: Leven JPS800 2 TB M.2-2280 PCIe 4.0 X4 NVME Solid State Drive  ($99.99 @ Amazon) 
Storage: Seagate ST6000NM0024 6 TB 3.5" 7200 RPM Internal Hard Drive  ($79.98 @ Amazon) 
Video Card: PNY XLR8 Gaming VERTO EPIC-X RGB OC GeForce RTX 4090 24 GB Video Card  ($1669.99 @ GameStop) 
Case: Montech AIR 903 MAX ATX Mid Tower Case  ($69.98 @ Amazon) 
Power Supply: be quiet! Straight Power 12 1500 W 80+ Platinum Certified Fully Modular ATX Power Supply  ($249.90 @ Amazon) 
Total: $4836.44
Prices include shipping, taxes, and discounts when available
Generated by PCPartPicker 2024-03-21 07:51 EDT-0400

Here’s a more traditional one; Since you’re a software dev I’m assuming you want strong multicore performance and good mt.
 

PCPartPicker Part List: https://pcpartpicker.com/list/bPqwn6

CPU: Intel Core i9-14900K 3.2 GHz 24-Core Processor  ($539.99 @ Newegg) 
CPU Cooler: Corsair iCUE H150i ELITE CAPELLIX XT 65.57 CFM Liquid CPU Cooler  ($180.63 @ Amazon) 
Motherboard: ASRock Z790 Pro RS ATX LGA1700 Motherboard  ($169.99 @ Newegg) 
Memory: Mushkin Redline ST 64 GB (2 x 32 GB) DDR5-6400 CL32 Memory  ($179.99 @ Newegg) 
Storage: Leven JPS800 2 TB M.2-2280 PCIe 4.0 X4 NVME Solid State Drive  ($99.99 @ Amazon) 
Storage: Seagate ST6000NM0024 6 TB 3.5" 7200 RPM Internal Hard Drive  ($79.98 @ Amazon) 
Video Card: PNY XLR8 Gaming VERTO EPIC-X RGB OC GeForce RTX 4090 24 GB Video Card  ($1669.99 @ GameStop) 
Case: Montech AIR 903 MAX ATX Mid Tower Case  ($69.98 @ Amazon) 
Power Supply: Gigabyte UD1000GM 1000 W 80+ Gold Certified Fully Modular ATX Power Supply  ($119.99 @ Amazon) 
Total: $3110.53
Prices include shipping, taxes, and discounts when available
Generated by PCPartPicker 2024-03-21 07:55 EDT-0400

What's the average performance / relevance timeline for threadripper? If these processors are improving x amount every year, when does this become irrelevant / potentially not upgradeable.

 

Also why are the PNY cards cheaper as opposed to MSI/Other cards. I do see that some MSI cards have liquid cooling, is that better for me? I'm not exactly sure how big the workloads are going to be for my project. But for comparison, let's say i'll be trying to train an open source llm model (even though i have absolutely no clue with how much data)

 

Here's what I came up with:

PCPartPicker Part List: https://pcpartpicker.com/list/dgWjQP 

CPU: AMD Threadripper 3970X 3.7 GHz 32-Core Processor  ($1770.99 @ Amazon) 
CPU Cooler: Corsair iCUE H150i ELITE CAPELLIX XT 65.57 CFM Liquid CPU Cooler  ($180.82 @ Amazon) 
Motherboard: Gigabyte TRX40 AORUS PRO WIFI ATX sTRX4 Motherboard  ($529.99 @ Amazon) 
Memory: Corsair Dominator Platinum RGB 64 GB (2 x 32 GB) DDR4-3600 CL18 Memory  ($224.99 @ Amazon) 
Storage: Sabrent Rocket 4 Plus 2 TB M.2-2280 PCIe 4.0 X4 NVME Solid State Drive  ($219.99 @ Amazon) 
Storage: Seagate Barracuda Compute 2 TB 3.5" 7200 RPM Internal Hard Drive  ($64.98 @ Amazon) 
Video Card: Asus ROG STRIX GAMING OC GeForce RTX 4090 24 GB Video Card  ($1999.99 @ ASUS) 
Case: NZXT H6 Flow ATX Mid Tower Case  ($100.99 @ Amazon) 
Power Supply: be quiet! Straight Power 12 1500 W 80+ Platinum Certified Fully Modular ATX Power Supply  ($249.90 @ Amazon) 
Total: $5342.64
Prices include shipping, taxes, and discounts when available
Generated by PCPartPicker 2024-03-21 19:31 EDT-0400

 

1. Does Threadripper 3990 not support ddr5? Would Xeon be a better bet?

2. Storage: Seagate Barracuda Compute 2 TB 3.5" 7200 RPM Internal Hard Drive  ($64.98 @ Amazon)  but Seagate ST6000NM0024 6 TB 3.5" 7200 RPM Internal Hard Drive  ($79.98 @ Amazon)  . 

   Why is there such a huge price difference  

   Also why are Samsung NVMEs so expensive? Is it just the brand?

3. Am I unnecessarily spending on something here?

20 hours ago, gmob said:

2. I currently have a CalDigital TH4 Element Hub that connects all my monitors and peripherals resulting in a single cable that plugs into my laptop. I'm mostly planning to ssh into the pc and run stuff, but would like the option of just plugging in the cable into the pc when I need to for either gaming or anything that cant be done through ssh, I feel like this might be tricky without a kvm for the keyboard / mouse.

Is this possible today?

 

Also found https://www.pugetsystems.com/solutions/scientific-computing-workstations/machine-learning-ai/buy-409/ interesting but I think that's going to be more expensive based on value of parts?

 

 

[Linuswasright]

6 minutes ago, gmob said:

Does Threadripper 3990 not support ddr5? Would Xeon be a better bet?

2. Storage: Seagate Barracuda Compute 2 TB 3.5" 7200 RPM Internal Hard Drive  ($64.98 @ Amazon)  but Seagate ST6000NM0024 6 TB 3.5" 7200 RPM Internal Hard Drive  ($79.98 @ Amazon)  . 

   Why is there such a huge price difference  

   Also why are Samsung NVMEs so expensive? Is it just the brand?

3. Am I unnecessarily spending on something here?

Iirc neither server/premier support ddr5
B:c each gb costs less once you go economy of scale enough.
Yes. Samsung is brand pricing. I love Samsung, and they own half my bloodline, but they make you overpay so so much for a Samsung premium.
ASUS is slapping rgb and making u pay triple for it (tho it looks aweeeesommmmmeeeee)
You only need watercooling if you’re over clocking to the moon.

[Linuswasright]

10 minutes ago, gmob said:

Yes I think you're right about that.

What's the average performance / relevance timeline for threadripper? If these processors are improving x amount every year, when does this become irrelevant / potentially not upgradeable.

 

Also why are the PNY cards cheaper as opposed to MSI/Other cards. I do see that some MSI cards have liquid cooling, is that better for me? I'm not exactly sure how big the workloads are going to be for my project. But for comparison, let's say i'll be trying to train an open source llm model (even though i have absolutely no clue with how much data)

 

Here's what I came up with:

PCPartPicker Part List: https://pcpartpicker.com/list/dgWjQP 

CPU: AMD Threadripper 3970X 3.7 GHz 32-Core Processor  ($1770.99 @ Amazon) 
CPU Cooler: Corsair iCUE H150i ELITE CAPELLIX XT 65.57 CFM Liquid CPU Cooler  ($180.82 @ Amazon) 
Motherboard: Gigabyte TRX40 AORUS PRO WIFI ATX sTRX4 Motherboard  ($529.99 @ Amazon) 
Memory: Corsair Dominator Platinum RGB 64 GB (2 x 32 GB) DDR4-3600 CL18 Memory  ($224.99 @ Amazon) 
Storage: Sabrent Rocket 4 Plus 2 TB M.2-2280 PCIe 4.0 X4 NVME Solid State Drive  ($219.99 @ Amazon) 
Storage: Seagate Barracuda Compute 2 TB 3.5" 7200 RPM Internal Hard Drive  ($64.98 @ Amazon) 
Video Card: Asus ROG STRIX GAMING OC GeForce RTX 4090 24 GB Video Card  ($1999.99 @ ASUS) 
Case: NZXT H6 Flow ATX Mid Tower Case  ($100.99 @ Amazon) 
Power Supply: be quiet! Straight Power 12 1500 W 80+ Platinum Certified Fully Modular ATX Power Supply  ($249.90 @ Amazon) 
Total: $5342.64
Prices include shipping, taxes, and discounts when available
Generated by PCPartPicker 2024-03-21 19:31 EDT-0400

 

1. Does Threadripper 3990 not support ddr5? Would Xeon be a better bet?

2. Storage: Seagate Barracuda Compute 2 TB 3.5" 7200 RPM Internal Hard Drive  ($64.98 @ Amazon)  but Seagate ST6000NM0024 6 TB 3.5" 7200 RPM Internal Hard Drive  ($79.98 @ Amazon)  . 

   Why is there such a huge price difference  

   Also why are Samsung NVMEs so expensive? Is it just the brand?

3. Am I unnecessarily spending on something here?

Is this possible today?

 

Also found https://www.pugetsystems.com/solutions/scientific-computing-workstations/machine-learning-ai/buy-409/ interesting but I think that's going to be more expensive based on value of parts?

 

 

Cut costs and made it slightly better
Eemeber - brand isn’t everything.
 

PCPartPicker Part List: https://pcpartpicker.com/list/xYjsfy

CPU: AMD Threadripper 3970X 3.7 GHz 32-Core Processor  ($1770.99 @ Amazon) 
CPU Cooler: Corsair iCUE H150i ELITE CAPELLIX XT 65.57 CFM Liquid CPU Cooler  ($180.82 @ Amazon) 
Motherboard: Gigabyte TRX40 AORUS PRO WIFI ATX sTRX4 Motherboard  ($529.99 @ Amazon) 
Memory: Mushkin Redline Lumina 64 GB (2 x 32 GB) DDR4-3600 CL16 Memory  ($132.99 @ Amazon) 
Memory: Mushkin Redline Lumina 64 GB (2 x 32 GB) DDR4-3600 CL16 Memory  ($132.99 @ Amazon) 
Storage: Western Digital Blue SN580 2 TB M.2-2280 PCIe 4.0 X4 NVME Solid State Drive  ($112.99 @ Newegg) 
Storage: Seagate ST6000NM0024 6 TB 3.5" 7200 RPM Internal Hard Drive  ($79.98 @ Amazon) 
Video Card: PNY XLR8 Gaming VERTO EPIC-X RGB OC GeForce RTX 4090 24 GB Video Card  ($1669.99 @ GameStop) 
Case: NZXT H6 Flow ATX Mid Tower Case  ($100.99 @ Amazon) 
Power Supply: be quiet! Straight Power 12 1500 W 80+ Platinum Certified Fully Modular ATX Power Supply  ($249.90 @ Amazon) 
Total: $4961.63
Prices include shipping, taxes, and discounts when available
Generated by PCPartPicker 2024-03-21 19:45 EDT-0400

[Linuswasright]

18 minutes ago, gmob said:

Yes I think you're right about that.

What's the average performance / relevance timeline for threadripper? If these processors are improving x amount every year, when does this become irrelevant / potentially not upgradeable.

 

Also why are the PNY cards cheaper as opposed to MSI/Other cards. I do see that some MSI cards have liquid cooling, is that better for me? I'm not exactly sure how big the workloads are going to be for my project. But for comparison, let's say i'll be trying to train an open source llm model (even though i have absolutely no clue with how much data)

 

Here's what I came up with:

PCPartPicker Part List: https://pcpartpicker.com/list/dgWjQP 

CPU: AMD Threadripper 3970X 3.7 GHz 32-Core Processor  ($1770.99 @ Amazon) 
CPU Cooler: Corsair iCUE H150i ELITE CAPELLIX XT 65.57 CFM Liquid CPU Cooler  ($180.82 @ Amazon) 
Motherboard: Gigabyte TRX40 AORUS PRO WIFI ATX sTRX4 Motherboard  ($529.99 @ Amazon) 
Memory: Corsair Dominator Platinum RGB 64 GB (2 x 32 GB) DDR4-3600 CL18 Memory  ($224.99 @ Amazon) 
Storage: Sabrent Rocket 4 Plus 2 TB M.2-2280 PCIe 4.0 X4 NVME Solid State Drive  ($219.99 @ Amazon) 
Storage: Seagate Barracuda Compute 2 TB 3.5" 7200 RPM Internal Hard Drive  ($64.98 @ Amazon) 
Video Card: Asus ROG STRIX GAMING OC GeForce RTX 4090 24 GB Video Card  ($1999.99 @ ASUS) 
Case: NZXT H6 Flow ATX Mid Tower Case  ($100.99 @ Amazon) 
Power Supply: be quiet! Straight Power 12 1500 W 80+ Platinum Certified Fully Modular ATX Power Supply  ($249.90 @ Amazon) 
Total: $5342.64
Prices include shipping, taxes, and discounts when available
Generated by PCPartPicker 2024-03-21 19:31 EDT-0400

 

1. Does Threadripper 3990 not support ddr5? Would Xeon be a better bet?

2. Storage: Seagate Barracuda Compute 2 TB 3.5" 7200 RPM Internal Hard Drive  ($64.98 @ Amazon)  but Seagate ST6000NM0024 6 TB 3.5" 7200 RPM Internal Hard Drive  ($79.98 @ Amazon)  . 

   Why is there such a huge price difference  

   Also why are Samsung NVMEs so expensive? Is it just the brand?

3. Am I unnecessarily spending on something here?

Is this possible today?

 

Also found https://www.pugetsystems.com/solutions/scientific-computing-workstations/machine-learning-ai/buy-409/ interesting but I think that's going to be more expensive based on value of parts?

 

 

If you want that you can build it for like ballpark of 2000

efit yep it’s like 2000$. It’s gonna be worse

[Linuswasright]

23 minutes ago, gmob said:

Yes I think you're right about that.

What's the average performance / relevance timeline for threadripper? If these processors are improving x amount every year, when does this become irrelevant / potentially not upgradeable.

 

Also why are the PNY cards cheaper as opposed to MSI/Other cards. I do see that some MSI cards have liquid cooling, is that better for me? I'm not exactly sure how big the workloads are going to be for my project. But for comparison, let's say i'll be trying to train an open source llm model (even though i have absolutely no clue with how much data)

 

Here's what I came up with:

PCPartPicker Part List: https://pcpartpicker.com/list/dgWjQP 

CPU: AMD Threadripper 3970X 3.7 GHz 32-Core Processor  ($1770.99 @ Amazon) 
CPU Cooler: Corsair iCUE H150i ELITE CAPELLIX XT 65.57 CFM Liquid CPU Cooler  ($180.82 @ Amazon) 
Motherboard: Gigabyte TRX40 AORUS PRO WIFI ATX sTRX4 Motherboard  ($529.99 @ Amazon) 
Memory: Corsair Dominator Platinum RGB 64 GB (2 x 32 GB) DDR4-3600 CL18 Memory  ($224.99 @ Amazon) 
Storage: Sabrent Rocket 4 Plus 2 TB M.2-2280 PCIe 4.0 X4 NVME Solid State Drive  ($219.99 @ Amazon) 
Storage: Seagate Barracuda Compute 2 TB 3.5" 7200 RPM Internal Hard Drive  ($64.98 @ Amazon) 
Video Card: Asus ROG STRIX GAMING OC GeForce RTX 4090 24 GB Video Card  ($1999.99 @ ASUS) 
Case: NZXT H6 Flow ATX Mid Tower Case  ($100.99 @ Amazon) 
Power Supply: be quiet! Straight Power 12 1500 W 80+ Platinum Certified Fully Modular ATX Power Supply  ($249.90 @ Amazon) 
Total: $5342.64
Prices include shipping, taxes, and discounts when available
Generated by PCPartPicker 2024-03-21 19:31 EDT-0400

 

1. Does Threadripper 3990 not support ddr5? Would Xeon be a better bet?

2. Storage: Seagate Barracuda Compute 2 TB 3.5" 7200 RPM Internal Hard Drive  ($64.98 @ Amazon)  but Seagate ST6000NM0024 6 TB 3.5" 7200 RPM Internal Hard Drive  ($79.98 @ Amazon)  . 

   Why is there such a huge price difference  

   Also why are Samsung NVMEs so expensive? Is it just the brand?

3. Am I unnecessarily spending on something here?

Is this possible today?

 

Also found https://www.pugetsystems.com/solutions/scientific-computing-workstations/machine-learning-ai/buy-409/ interesting but I think that's going to be more expensive based on value of parts?

 

 

More mainstream one, with i9-14900ks & ddr5
 

PCPartPicker Part List: https://pcpartpicker.com/list/b8GtdH

CPU: Intel Core i9-14900KS 3.2 GHz 24-Core Processor  ($699.99 @ B&H) 
CPU Cooler: Corsair iCUE H150i ELITE CAPELLIX XT 65.57 CFM Liquid CPU Cooler  ($189.99 @ Amazon) 
Motherboard: Asus TUF GAMING Z790-PRO WIFI ATX LGA1700 Motherboard  ($279.99 @ Amazon) 
Memory: Mushkin Redline ST 64 GB (2 x 32 GB) DDR5-6400 CL30 Memory  ($189.99 @ Newegg) 
Storage: Western Digital Blue SN580 2 TB M.2-2280 PCIe 4.0 X4 NVME Solid State Drive  ($112.99 @ Newegg) 
Storage: Seagate ST6000NM0024 6 TB 3.5" 7200 RPM Internal Hard Drive  ($79.98 @ Amazon) 
Video Card: PNY XLR8 Gaming VERTO EPIC-X RGB OC GeForce RTX 4090 24 GB Video Card  ($1669.99 @ GameStop) 
Case: NZXT H6 Flow ATX Mid Tower Case  ($100.99 @ Amazon) 
Power Supply: be quiet! Straight Power 12 1500 W 80+ Platinum Certified Fully Modular ATX Power Supply  ($249.90 @ Amazon) 
Total: $3573.81
Prices include shipping, taxes, and discounts when available
Generated by PCPartPicker 2024-03-21 19:56 EDT-0400

[gmob]

 

7 hours ago, Linuswasright said:

PCPartPicker Part List: https://pcpartpicker.com/list/b8GtdH

CPU: Intel Core i9-14900KS 3.2 GHz 24-Core Processor  ($699.99 @ B&H) 
CPU Cooler: Corsair iCUE H150i ELITE CAPELLIX XT 65.57 CFM Liquid CPU Cooler  ($189.99 @ Amazon) 
Motherboard: Asus TUF GAMING Z790-PRO WIFI ATX LGA1700 Motherboard  ($279.99 @ Amazon) 
Memory: Mushkin Redline ST 64 GB (2 x 32 GB) DDR5-6400 CL30 Memory  ($189.99 @ Newegg) 
Storage: Western Digital Blue SN580 2 TB M.2-2280 PCIe 4.0 X4 NVME Solid State Drive  ($112.99 @ Newegg) 
Storage: Seagate ST6000NM0024 6 TB 3.5" 7200 RPM Internal Hard Drive  ($79.98 @ Amazon) 
Video Card: PNY XLR8 Gaming VERTO EPIC-X RGB OC GeForce RTX 4090 24 GB Video Card  ($1669.99 @ GameStop) 
Case: NZXT H6 Flow ATX Mid Tower Case  ($100.99 @ Amazon) 
Power Supply: be quiet! Straight Power 12 1500 W 80+ Platinum Certified Fully Modular ATX Power Supply  ($249.90 @ Amazon) 
Total: $3573.81
Prices include shipping, taxes, and discounts when available
Generated by PCPartPicker 2024-03-21 19:56 EDT-0400

Hmm I'm slightly split between Intel I9-14900 vs Threadripper. Right now, I'm leaning more towards ^

 

The Asus TUF GAMING Z790-PRO does seem to have a TH USB4, do you think this would work with the dock setup? I'm a bit confused how a TH4 port on a motherboard would work with a graphics card?

 

Additionally, I'm also looking for a couple mini PCs to run some bots + clients for the server. I have a RasPi but I don't think that's going to cut it. These would eventually communicate with the main PC but I want to run them in isolation. Mediocre processing power is acceptable but I do want to be able to upgrade memory if necessary. Any recommendations?

[Linuswasright]

2 hours ago, gmob said:

 

Hmm I'm slightly split between Intel I9-14900 vs Threadripper. Right now, I'm leaning more towards ^

 

The Asus TUF GAMING Z790-PRO does seem to have a TH USB4, do you think this would work with the dock setup? I'm a bit confused how a TH4 port on a motherboard would work with a graphics card?

 

Additionally, I'm also looking for a couple mini PCs to run some bots + clients for the server. I have a RasPi but I don't think that's going to cut it. These would eventually communicate with the main PC but I want to run them in isolation. Mediocre processing power is acceptable but I do want to be able to upgrade memory if necessary. Any recommendations?

You could buy old optiolexs and refurbish them. ~60$ each, slap in a gpu and it’s ~200 for a mid-low end pc. I’ve done it before, you can make decent pcs with that strategy. Maybe a z420 or whatever will be better because it’s a Xeon.

 

I believe it should, no reason why it wouldn’t.

 

[igormp]

On 3/21/2024 at 2:47 AM, gmob said:

Also any comments / suggestions on Nvidia drivers (for gamer cards) on windows vs linux on speed and performance? 

 

Nvidia on windows for ML workloads is a good 20~50% slower than linux.

For games windows has an advantage but I'm not sure how much faster it is.

On 3/21/2024 at 11:35 PM, gmob said:

Is this possible today?

 

I have a USB-C hub/kvm that I used to use to switch between my desktop and work laptop, my 4k tv and m+k worked fine with it, so just get a mobo that supports this kind of thing and you should be good.

 

On 3/21/2024 at 11:35 PM, gmob said:

Also found https://www.pugetsystems.com/solutions/scientific-computing-workstations/machine-learning-ai/buy-409/ interesting but I think that's going to be more expensive based on value of parts?

Just build your own 7950x rig with 192gb of ram and two used 3090s, way more cost effective and you'll still have pretty nice performance. Just keep in mind that only a few AM5 motherboards can do x8/x8 on the PCIe slots.

On 3/22/2024 at 8:05 AM, gmob said:

Hmm I'm slightly split between Intel I9-14900 vs Threadripper. Right now, I'm leaning more towards ^

 

If you're going to do lots of data-related stuff with numpy and whatnot, don't go for intel since they lack avx-512, newest Ryzens are a best fit for this task.

[gmob]

On 3/22/2024 at 3:35 AM, Linuswasright said:

You could buy old optiolexs and refurbish them. ~60$ each, slap in a gpu and it’s ~200 for a mid-low end pc. I’ve done it before, you can make decent pcs with that strategy. Maybe a z420 or whatever will be better because it’s a Xeon.

 

I believe it should, no reason why it wouldn’t.

 

Thanks a great idea! Already looking into that.

 

11 hours ago, igormp said:

Just build your own 7950x rig with 192gb of ram and two used 3090s, way more cost effective and you'll still have pretty nice performance. Just keep in mind that only a few AM5 motherboards can do x8/x8 on the PCIe slots.

Any recommendations?

 

11 hours ago, igormp said:

so just get a mobo that supports this kind of thing and you should be good.

With all the constraints and especially special mobos for xeons/threadrippers i hope there are some out there that can support that. I do have Xeon workstations at work that don't have it, they're also pretty old.

 

11 hours ago, igormp said:

If you're going to do lots of data-related stuff with numpy and whatnot, don't go for intel since they lack avx-512, newest Ryzens are a best fit for this task.

Definitely going to involve a bunch of numpy, and dealing with a lot of data processing before i even attempt to train a model. Pc part picker doesn't even list the newer threadrippers lol. I have a friend who works at intel and can help me get Xeons at a much cheaper price. Do you think Xeons are a better bet than the 14900?

[igormp]

1 hour ago, gmob said:

Any recommendations?

Take a look at this:

On 12/9/2023 at 3:41 PM, igormp said:

There was a discussion in another thread about this with some options:

 

None of them are really cheap, guess I'll keep going happily with my AM4 setup lol

 

1 hour ago, gmob said:

Definitely going to involve a bunch of numpy, and dealing with a lot of data processing before i even attempt to train a model. Pc part picker doesn't even list the newer threadrippers lol. I have a friend who works at intel and can help me get Xeons at a much cheaper price. Do you think Xeons are a better bet than the 14900?

If you can get one if the newest xeon WS based in sapphire rapids for cheap, then sure, they'd be awesome and solve any worry you may have when it comes do upgradability or performance.

[gmob]

Things are getting trickier since PCPartPicker doesn't list parts for workstations

 

I'm now considering 

 

Intel® Xeon® w5-3435X https://www.newegg.com/intel-xeon-w5-3435x-lga-4677/p/N82E16819118452 ($1200 Buying through intel internally)

ASRock W790 WS Intel https://www.newegg.com/p/N82E16813162113?Item=N82E16813162113&cm_sp=combodetail-combooption ($879)

 

Rest from PPP:

CPU Cooler: Corsair iCUE H150i ELITE CAPELLIX XT 65.57 CFM Liquid CPU Cooler  ($189.99 @ Amazon) 
Memory: Mushkin Redline ST 64 GB (2 x 32 GB) DDR5-6400 CL30 Memory  ($189.99 @ Newegg) 
Storage: Western Digital Blue SN580 2 TB M.2-2280 PCIe 4.0 X4 NVME Solid State Drive  ($112.99 @ Newegg) 
Storage: Seagate ST6000NM0024 6 TB 3.5" 7200 RPM Internal Hard Drive  ($79.98 @ Amazon) 
Video Card: PNY XLR8 Gaming VERTO EPIC-X RGB OC GeForce RTX 4090 24 GB Video Card  ($1669.99 @ GameStop) 
Case: NZXT H6 Flow ATX Mid Tower Case  ($100.99 @ Amazon) 
Power Supply: be quiet! Straight Power 12 1500 W 80+ Platinum Certified Fully Modular ATX Power Supply  ($249.90 @ Amazon) 

Total: ~$5567

 

Going with a single 4090 for now and will add another one if I think it's not enough.

 

Wondering if the CPU cooler is compatible and also if power supply is enough.

[igormp]

5 hours ago, gmob said:

Things are getting trickier since PCPartPicker doesn't list parts for workstations

 

I'm now considering 

 

Intel® Xeon® w5-3435X https://www.newegg.com/intel-xeon-w5-3435x-lga-4677/p/N82E16819118452 ($1200 Buying through intel internally)

ASRock W790 WS Intel https://www.newegg.com/p/N82E16813162113?Item=N82E16813162113&cm_sp=combodetail-combooption ($879)

 

Rest from PPP:

CPU Cooler: Corsair iCUE H150i ELITE CAPELLIX XT 65.57 CFM Liquid CPU Cooler  ($189.99 @ Amazon) 
Memory: Mushkin Redline ST 64 GB (2 x 32 GB) DDR5-6400 CL30 Memory  ($189.99 @ Newegg) 
Storage: Western Digital Blue SN580 2 TB M.2-2280 PCIe 4.0 X4 NVME Solid State Drive  ($112.99 @ Newegg) 
Storage: Seagate ST6000NM0024 6 TB 3.5" 7200 RPM Internal Hard Drive  ($79.98 @ Amazon) 
Video Card: PNY XLR8 Gaming VERTO EPIC-X RGB OC GeForce RTX 4090 24 GB Video Card  ($1669.99 @ GameStop) 
Case: NZXT H6 Flow ATX Mid Tower Case  ($100.99 @ Amazon) 
Power Supply: be quiet! Straight Power 12 1500 W 80+ Platinum Certified Fully Modular ATX Power Supply  ($249.90 @ Amazon) 

Total: ~$5567

 

Going with a single 4090 for now and will add another one if I think it's not enough.

 

Wondering if the CPU cooler is compatible and also if power supply is enough.

Keep in mind that those workstation CPUs do NOT work with UDIMM RAM, you'll need to buy ECC RDIMMs. 

 

PSU is more than enough, no idea about the cooler though because I'm not good at those things.

[gmob]

13 minutes ago, igormp said:

Keep in mind that those workstation CPUs do NOT work with UDIMM RAM, you'll need to buy ECC RDIMMs. 

 

PSU is more than enough, no idea about the cooler though because I'm not good at those things.

aaagh building a workstation is so annoying.

 

Also https://www.cpubenchmark.net/compare/5486vs5957/Intel-Xeon-w5-3435X-vs-Intel-i9-14900KS . Because clearly i9 14900 is faster, is it just more number of channels for memory / pci for the cost difference? 

I don't think ill go beyond two gpus on the build. So might just stick with it for now. 

[igormp]

2 hours ago, gmob said:

aaagh building a workstation is so annoying.

 

Also https://www.cpubenchmark.net/compare/5486vs5957/Intel-Xeon-w5-3435X-vs-Intel-i9-14900KS . Because clearly i9 14900 is faster, is it just more number of channels for memory / pci for the cost difference? 

I don't think ill go beyond two gpus on the build. So might just stick with it for now. 

Do

 

2 hours ago, gmob said:

aaagh building a workstation is so annoying.

 

Also https://www.cpubenchmark.net/compare/5486vs5957/Intel-Xeon-w5-3435X-vs-Intel-i9-14900KS . Because clearly i9 14900 is faster, is it just more number of channels for memory / pci for the cost difference? 

I don't think ill go beyond two gpus on the build. So might just stick with it for now. 

The xeon has avx-512, while the 14900 does not, and that will make a noticeable difference in your python workloads. 

But yeah, the bulk of the difference comes down to the platform itself, with more memory channels and pci lanes. 

 

If you won't go past 2 GPUs, I really recommend just going for a 7950x with 128~192gb of RAM and one of the mobos in my previous post. 

Otherwise, if you want to save a buck and cpu isn't that relevant, go for a AM4 platform with 128gb of RAM, or even go Intel with DDR4 for cheap.

(but as you said you'll be doing tons of pre processing, then the Ryzen on Am5 is what I'd recommend in the end)

[Linuswasright]

39 minutes ago, igormp said:

Do

 

The xeon has avx-512, while the 14900 does not, and that will make a noticeable difference in your python workloads. 

But yeah, the bulk of the difference comes down to the platform itself, with more memory channels and pci lanes. 

 

If you won't go past 2 GPUs, I really recommend just going for a 7950x with 128~192gb of RAM and one of the mobos in my previous post. 

Otherwise, if you want to save a buck and cpu isn't that relevant, go for a AM4 platform with 128gb of RAM, or even go Intel with DDR4 for cheap.

(but as you said you'll be doing tons of pre processing, then the Ryzen on Am5 is what I'd recommend in the end)

I think he might want to go am5 or 1700 just for the ddr5, it’s pretty helpful. Other than that i agree, though 7950x3d wouldn’t actively hurt

[igormp]

3 hours ago, Linuswasright said:

I think he might want to go am5 or 1700 just for the ddr5, it’s pretty helpful. Other than that i agree, though 7950x3d wouldn’t actively hurt

DDR5 does deliver some improvements, but honestly it's not worth the cost (thinking just about it). Major benefit is actually the higher capacities avaliable instead of the speed. 

 

The x3D model would actually hurt. For the mentioned workloads it's slower and more expensive than the regular model, there's no benefit to it.

[Linuswasright]

14 minutes ago, igormp said:

DDR5 does deliver some improvements, but honestly it's not worth the cost (thinking just about it). Major benefit is actually the higher capacities avaliable instead of the speed. 

 

The x3D model would actually hurt. For the mentioned workloads it's slower and more expensive than the regular model, there's no benefit to it.

Huh didn’t know that