Jump to content
Search In
  • More options...
Find results that contain...
Find results in...
harshitaneja

Recommendation for multi-GPU setup

Recommended Posts

Posted · Original PosterOP

Building a workstation with threadripper 2950X(need the cores) and 3 GPU- 1x 2080Ti and 2x 2080.

Mostly for data science work. NVLink is not needed as work will be parallelized across multiple GPUs. 

 

Need help with GPU recommendations(CUDA support required) and motherboard. I need to live in the same room as this device which will run 24x7 so would need to really quiet. Water or air cooling? I live in India where it is tough to find people to help with water cooling(at least that I know of) so would be doing it myself. Is IChill Black 2080Ti a good option?

 

Any suggestions or recommendations or pointers to places I could ask or read at. Thanks a lot for the help.

Link to post
Share on other sites

What workload are you going to do exactly? you might be better served with a single TITAN V due to the increased Tensor and Cuda Core count alongside driver specific optimizations and certification.

 

It is not uncommon to see the TITAN V sweeping the floor with a 2080 Ti on hardware acceleration workloads and there's water blocks for it to make up the loud FE cooler.

 

The thing is, depending on what you'll do a single TITAN V may perform on pair with a 2080 Ti + 2x 2080 and if that's the case you might not even need the extra PCI-e Lanes meaning you could further save up money on an i9 9900K instead of a TR 2950X build.


Workstation Rig:
CPU:  Intel Core i9 9900K @4.7ghz  |~| Cooling: Noctua NH-U12P |~|  MOBO: Asus Z390M ROG Maximus XI GENE |~| RAM: 32gb 3200mhz CL16 G.Skill Trident Z RGB |~| GPU: nVidia TITAN V  |~| PSU: Corsair RM850X 80Plus Gold |~| Boot: WD Black M.2 2280 500GB NVMe |~| Storage: 2X4TB HDD 7200rpm Seagate Iron Wolf + 2X2TB SSD SanDisk Ultra |~| Case: Cooler Master Case Pro 3 |~| Display: ASUS ROG Swift PG348Q 3440x1440p100hz |~| OS: Windows 10 Pro.
Personal Use Rig:
CPU: Intel Core i7 8700 @4.45ghz |~| Cooling: Cooler Master Hyper 212X |~| MOBO: Gigabyte Z370M D3H mATX|~| RAM: 16gb DDR4 3333mhzCL16 G.Skill Trident Z |~| GPU: nVidia Founders Edition GTX 1080 Ti |~| PSU: Corsair TX650M 80Plus Gold |~| Boot:  SSD WD Green M.2 2280 240GB |~| Storage: 1x3TB HDD 7200rpm Seagate Barracuda + SanDisk SSD Plus G26 480gb |~| Case: Cooler Master Case Pro 3 |~| Display Setup: Acer X34 3440x1440p100hz |~| OS: Windows 10 Pro.
Link to post
Share on other sites
Posted · Original PosterOP
7 minutes ago, Princess Cadence said:

What workload are you going to do exactly? you might be better served with a single TITAN V due to the increased Tensor and Cuda Core count alongside driver specific optimizations and certification.

 

It is not uncommon to see the TITAN V sweeping the floor with a 2080 Ti on hardware acceleration workloads and there's water blocks for it to make up the loud FE cooler.

 

The thing is, depending on what you'll do a single TITAN V may perform on pair with a 2080 Ti + 2x 2080 and if that's the case you might not even need the extra PCI-e Lanes meaning you could further save up money on an i9 9900K instead of a TR 2950X build.

Thanks for the response. Titan V is an older card which has similar if not worse performance in certain cases in comparison to 2080Ti in FP16 workloads. Even in FP32 difference isn't large enough to warrant paying around 2.5x for it. I think you are confusing it with Titan RTX. Even though Titan cards have 24GB of memory in comparison to 11GB of a single 2080Ti. But total memory of all three planned GPUs 11+8+8 (GB) should be sufficient to counter that(now I know I am comparing a single memory with sum of multiple memories which is not a straightforward comparison) without much of an increase in price. With this given that my work mostly is parallelizable I can run it across all the three at the same time which should give higher performance and if not, it offers the benefit of running different models on all the three GPUs. 

I need the 16 cores offered by 2950X(well I wanted the 32 core 2990WX but couldn't justify the cost) as I need to run a lot of virtual machines and some of statistical work is done using libraries which don't yet have GPU options and thus need the cores for that. So PCIe lanes are not an issue.

Thanks again for your input.

Link to post
Share on other sites
Posted · Original PosterOP
6 minutes ago, GoldenLag said:

Or just get a 1920x as it seems he might only need PCIe lanes. 

Maybe I should have mentioned it in the answer, 2950X is for the extra cores as some of my work involves running statistical libraries which are currently CPU only. Extra PCIe lanes are cherry on top.

Link to post
Share on other sites
5 minutes ago, harshitaneja said:

-snip-.

What workload specifically?

 

If it can use OpenCL you will have much more success with tripple Radeon 7 cards.

Link to post
Share on other sites
Posted · Original PosterOP
1 minute ago, GoldenLag said:

What workload specifically?

 

If it can use OpenCL you will have much more success with tripple Radeon 7 cards.

CUDA is sadly required as tensorflow and certain others only support it which is bad as I really don't want Nvidia being a linux user and their abysmal driver support. I have edited the question to include CUDA support.

Link to post
Share on other sites

For graphics cards, AIO water cooling cards are recommended if you have enough space to mount radiators. Radial fan cooling card is second choise. Never use axial fan colling card in multi-card setup.

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

Buy VPN

×