2000$ CAD, AI pc

[Idkwhattodowithmylife]

Budget (including currency): 2000

Country: canada

Games, programs or workloads that it will be used for: running ai

Other details (existing parts lists, whether any peripherals are needed, what you're upgrading from, when you're going to buy, what resolution and refresh rate you want to play at, etc): 

I mean I need a PC to run ai. idk about workstation shit, just regular gaming stuff. i will build it myself, just has to be in canadaian retailers / easily obtainable in canada

[Somerandomtechyboi]

https://ca.pcpartpicker.com/list/Mwbn6Q

7700 + 1x 3090 1x 3060 + 32gb 6000c30

 

other than the beefy psu and strange gpu config this is basically just a normal gaming build

 

7700 are 258$ on aliexpress, otherwise feel free to substitute for a 7600

 

afaik training LLMs and whatnot needs lots of vram and an nvidia card so the 3090 and 3060 fit the bill, the prices i put in are guesstimates but likely somewhat close to what you can find em for on the used market and make sure to get a 3090 thats not too thick so it doesnt get choked by the 3060 or just block the second x16 entirely prefferably something with a cooler height thats close to 2 slots

[Idkwhattodowithmylife]

36 minutes ago, Somerandomtechyboi said:

https://ca.pcpartpicker.com/list/Mwbn6Q

7700 + 1x 3090 1x 3060 + 32gb 6000c30

 

other than the beefy psu and strange gpu config this is basically just a normal gaming build

 

7700 are 258$ on aliexpress, otherwise feel free to substitute for a 7600

 

afaik training LLMs and whatnot needs lots of vram and an nvidia card so the 3090 and 3060 fit the bill, the prices i put in are guesstimates but likely somewhat close to what you can find em for on the used market and make sure to get a 3090 thats not too thick so it doesnt get choked by the 3060 or just block the second x16 entirely prefferably something with a cooler height thats close to 2 slots

 

36 minutes ago, Somerandomtechyboi said:

https://ca.pcpartpicker.com/list/Mwbn6Q

7700 + 1x 3090 1x 3060 + 32gb 6000c30

 

other than the beefy psu and strange gpu config this is basically just a normal gaming build

 

7700 are 258$ on aliexpress, otherwise feel free to substitute for a 7600

 

afaik training LLMs and whatnot needs lots of vram and an nvidia card so the 3090 and 3060 fit the bill, the prices i put in are guesstimates but likely somewhat close to what you can find em for on the used market and make sure to get a 3090 thats not too thick so it doesnt get choked by the 3060 or just block the second x16 entirely prefferably something with a cooler height thats close to 2 slots

You cant even find 3090s in the market here, would a Tesla v100 32gb work? Or 2x 3080s?

Also would this be good for flux ai

[igormp]

16 hours ago, Somerandomtechyboi said:

afaik training LLMs and whatnot needs lots of vram and an nvidia card so the 3090 and 3060 fit the bill, the prices i put in are guesstimates but likely somewhat close to what you can find em for on the used market and make sure to get a 3090 thats not too thick so it doesnt get choked by the 3060 or just block the second x16 entirely prefferably something with a cooler height thats close to 2 slots

There's no reason to go with both a 3090 and a 3060. Either go with just a single 3090, or grab more 3090s.

16 hours ago, Idkwhattodowithmylife said:

You cant even find 3090s in the market here, would a Tesla v100 32gb work? Or 2x 3080s?

Also would this be good for flux ai

V100 would be really nice due to the vram amount, just make sure you're looking at the PCIe version.

3080s would be nice if you can get the 12gb version, or 3080 Tis.

 

Another option would be grabbing 4060Ti 16GB, those are pretty nice for ML due to the vram and often cheap, you could grab 2 of those for 32GB.

 

Is flux all you plan on running?

[Idkwhattodowithmylife]

17 minutes ago, igormp said:

There's no reason to go with both a 3090 and a 3060. Either go with just a single 3090, or grab more 3090s.

V100 would be really nice due to the vram amount, just make sure you're looking at the PCIe version.

3080s would be nice if you can get the 12gb version, or 3080 Tis.

 

Another option would be grabbing 4060Ti 16GB, those are pretty nice for ML due to the vram and often cheap, you could grab 2 of those for 32GB.

 

Is flux all you plan on running?

3080 12gb / 3080ti is way to expensive, that would be 1400 on its own. Same with the 4060ti, it's 700 each, same price as 3080. V100s are out of stock, they were in stock yesterday 

 

I'm pretty sure flux is all, but there might be some other ones

 

 

[igormp]

1 hour ago, Idkwhattodowithmylife said:

3080 12gb / 3080ti is way to expensive, that would be 1400 on its own. Same with the 4060ti, it's 700 each, same price as 3080. V100s are out of stock, they were in stock yesterday 

 

I'm pretty sure flux is all, but there might be some other ones

WIth less than 12GB you're going to spend way more time, even if the GPU is faster.

Honestly, either grab a used 3090 for its 24GB, try to grab a 4060ti 16gb, or go with a 3060 12gb.