Jump to content

Data Analysis and AI machine

Dr. Will0hlep
By Dr. Will0hlep
in New Builds and Planning
 Share
Posted

Budget (including currency): Alot

Country: United Kingdom

Games, programs or workloads that it will be used for: Some civil engineering, some ML, RL, AI training tasks, some database work, among other data analysis tasks.

Other details (existing parts lists, whether any peripherals are needed, what you're upgrading from, when you're going to buy, what resolution and refresh rate you want to play at, etc): None

 

Presently I have two interesting quotes.

 

The first is for a (dell prebuilt, yuck)

AMD Ryzen Threadripper PRO 7985WX

Nvidia RTX 4000 Ada

2 x 16 GB DDR5 5200 MT/s ECC Ram

for £9,350.00 + VAT


while the second is for a (prebuilt using off the shelf parts)

AMD Ryzen Threadripper PRO 7985WX 64 Core CPU

32GB Kingston DDR5 4800MHz ECC Registered (2 x 16GB)
12GB ZOTAC GEFORCE RTX 5070 SOLID - HDMI, 3 x DP

for £7807.50 + VAT
 

Is one of these quotes a better deal than the other? How much of a better deal could I get building something different myself? How does the 5070 compare to the 4000 in these workloads?

 

Thanks for your help.

I might be experienced, but I'm human and I do make mistakes. Trust but Verify! I edit my messages after sending them alot, please refresh before posting your reply. Please try to be clear and specific, you'll get a better answer. Please remember to mark solutions once you have the information you need. Expand this signature for common PC building advice, a short bio and a list of my components.

 

Common build advice:

1) Buy the cheapest (well reviewed) motherboard that has the features you need. Paying more typically only gets you features you won’t use. 2) only get as much RAM as you need, getting more won’t (typically) make your PC faster. 3) While I recommend getting an NVMe drive, you don’t need to splurge for an expensive drive with DRam cache, DRamless drives are fine for gamers. 4) paying for looks is fine, just don’t break the bank. 5) Tower coolers are usually good enough, unless you go top tier Intel or plan on OCing. 6) OCing is a dead meme, you probably shouldn’t bother. 7) "Bottlenecks" rarely matter and "Future-proofing" is a myth. 8) AIOs don't noticeably improve performance past 240mm and don't improve at all past 360mm. 9) RTFM.

 

Useful Websites:

https://www.productchart.com - helps compare monitors, https://uk.pcpartpicker.com - makes designing a PC easier.

 

Bio:

He/Him - I'm a PhD student working in the fields of reinforcement learning and traffic control. PCs are one of my hobbies and I've built many PCs and performed upgrades on a few laptops (for myself, friends and family). My personal computers include 4 windows (10/11) machines and a TrueNAS server (and I'm looking to move to dual booting Linux Mint on my main machine in future). Aside from computers, I also dabble in modding/homebrew retro consoles, support Southampton FC, and enjoy Scuba Diving and Skiing.

Fun Facts

1) When I was 3 years old my favourite toy was a scientific calculator. 2) My father is a British Champion ploughman in the Vintage Hydraulic Class. 3) On Speedrun.com, I'm the world record holder for the Dream Bobsleigh event on Mario & Sonic at the Olympic Winter Games 2010.

 

My Favourite Games: World of Tanks, Runescape, Subnautica, Metroid (Fusion and Dread), Spyro: Year of the Dragon (Original and Reignited Trilogy), Crash Bash, Mario Kart Wii, Balatro

 

My Computers: Primary: My main gaming rig - https://uk.pcpartpicker.com/user/will0hlep/saved/NByp3C Second: Hosts Discord bots as well as a Minecraft and Ark server, and also serves as a reinforcement learning sand box - https://uk.pcpartpicker.com/user/will0hlep/saved/cc9K7P NAS: TrueNAS Scale NAS hosting SMB shares, DDNS updater, pi-hole, and a Jellyfin server - https://uk.pcpartpicker.com/user/will0hlep/saved/m37w3C Foldatron: My folding@home and BOINC rig (partially donated to me by Folding Team Leader GOTSpectrum) - Mobile: Mini-ITX gaming rig for when I'm away from home -

Link to comment
https://linustechtips.com/topic/1605037-data-analysis-and-ai-machine/
Share on other sites
Link to post
Share on other sites
Posted

You will need more than 12GB vram quite fast.

mY sYsTeM iS Not pErfoRmInG aS gOOd As I sAW oN yOuTuBe. WhA t IS a GoOd FaN CuRVe??!!? wHat aRe tEh GoOd OvERclok SeTTinGS FoR My CaRd??  HoW CaN I foRcE my GpU to uSe 1o0%? BuT WiLL i HaVE Bo0tllEnEcKs? RyZEN dOeS NoT peRfORm BetTer wItH HiGhER sPEED RaM!!! dId i WiN teH SiLiCON LotTerrY? yOu ShoUlD dEsHrOuD uR GPU. my SYstEm iS UNDerPerforMiNg iN WarzONE. can mY Pc Run WiNdOwS 11 ?? woUld BaKInG MY GRaPHics card fIX it? MultimETeR TeSTiNG!! aMd'S GpU DrIvErS aRe as goOD aS NviDia's YOU SHoUlD oVERCloCk yOUR ramS To 5000C18! jellYfIn Client siDE TRanscoDinG

Link to post
Share on other sites
Posted

 

So, what you need to do:

1) Figure out which are your top 2 or 3 most important workloads.  Not this CVS reciept of "everything under the sun"

 

2) Look up what apps you'll be using to run those workloads.  Find out how many CPU Cores / Threads those support, Most apps don't support 64/128 cores/threads.

 

3) Purchase shit based on *that* not based on whatever.  

 

If AI/ML is your top priority?

Spend *way more fuckin' money* on a GPU.  Or two.  Most of these apps will leverage multiple GPUs.  Get a pair of 4090's or something.  

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
 Share
Go to topic listing New Builds and Planning

×