GPU for AI research

[Madlajos]

Hi all!

 

My research team at the university recently started AI image processing. We mainly use Mask-RCNN, but other fields may also come up later.

Right now we are using a 2070 for training and image processing, but we just got a fund of ~3000 USD to buy GPUs.

My task is to choose which GPU(s) to buy, can you guys help me out? What would be the best price to performance option? In my country, a Titan RTX costs ~3000 USD, a 2080Ti about 1500 USD, a 2080 750 USD.

Would it be better to buy one all out GPU, or buy more less expensive ones?

 

Thanks in advance!

[AndreiArgeanu]

Go for the cheaper ones, four 2080's are better than one Titan RTX or two 2080ti's. That does depend on how they're used, if your AI research requires a lot of gpu memory than the Titan RTX might be the better choice with 24gb of gddr6 ram. Otherwise four 2080's seem the best choice as it offers the most performance out of them. I also left a table below with some specs of the 2080 and 2080 ti to help you out.

[Madlajos]

Just now, AndreiArgeanu said:

Go for the cheaper ones, four 2080's are better than one Titan RTX or two 2080ti's. That does depend on how they're used, if your AI research requires a lot of gpu memory than the Titan RTX might be the better choice with 24gb of gddr6 ram. Otherwise four 2080's seem the best choice as it offers the most performance out of them. I also left a table below with some specs of the 2080 and 2080 ti to help you out.

Thanks! Is it possible to link the memory of multiple GPUs together? As far as I know, Nvlink does that, but I guess that only works for 2 cards.

[Its_MrMa]

23 minutes ago, Madlajos said:

Hi all!

 

My research team at the university recently started AI image processing. We mainly use Mask-RCNN, but other fields may also come up later.

Right now we are using a 2070 for training and image processing, but we just got a fund of ~3000 USD to buy GPUs.

My task is to choose which GPU(s) to buy, can you guys help me out? What would be the best price to performance option? In my country, a Titan RTX costs ~3000 USD, a 2080Ti about 1500 USD, a 2080 750 USD.

Would it be better to buy one all out GPU, or buy more less expensive ones?

 

Thanks in advance!

i think the 2080 is a good choice. if you find the 2080 super for a little more, get that.

[Madlajos]

If the memory of these 4 GPUs can be linked together, they seem to be the best choice. Idk if thats possible. 

[Haro]

14 minutes ago, Madlajos said:

If the memory of these 4 GPUs can be linked together, they seem to be the best choice. Idk if thats possible. 

Pascal and above only supports 2 way SLI or NVlink but it is possible to utilize all of these gpus power