Dual GPU setup

[Chris-Same]

Hi All, I have a question for a dual GPU setup for a ubuntu machine learning setup. I have an RTX3090 and it is working great in my setup. I would like to add another gpu and I was thinking of the A6000 actually. I know you can't easily mix gpus but they both use the same driver when I checked (https://www.nvidia.com/Download/driverResults.aspx/209261/en-us/). Is there any reason not to try this?

[igormp]

6 hours ago, Chris-Same said:

I know you can't easily mix gpus

You can.

6 hours ago, Chris-Same said:

Is there any reason not to try this?

How are you planning on using those GPUs? If it's for training the same model, be aware that doing data parallelism may be underutilizing the A6000 since you'll be limited by the batch size of the 3090, so you'd need to take care of that by yourself in order to make proper use of those GPUs.

Model parallelism is another option, but it has it's a can of worms on its own, so good luck you're going this way.

 

If you plan on using each GPU for an entirely different task, then there should be no issues whatsoever (other than maybe lack of system ram for both processes).