Yes. You might have to specify which device to use though. You also can’t combine memory into one pool, but you can parallelize.

Oh nice. Thank you.

Unless he gets nvlink

Is that confirmed to work? I’ve read mixed on same GPU connected by NVLINK.

Works fine with my A5000s

Cool might try that with my 2080s then. Thnx.

>Now if I connect my 2060 along with the gtx 980, and connect my display to the 980 , will pytorch be use the whole vram of 2060 ?

Yes, I have a similar setup, RTX3090 - No display (full VRAM for training), RTX3060 - 2 Monitors

When I play games, I connect 1 monitor to RTX3090 and play on that, other monitor on RTX3060

Here is a thread where we talked about this with GeForce cards. It's not treated as a single GPU and apparently you still need to parallelize. At least that's what I was told in that thread.

How would a 2x A5000 system differ from a single A6000 in actual use? Are your cards treated as a single card by the software?

Depending on my set up, do you think 850 watt PSU will be good enough ? My CPU is i7 6700k.

Looks like, GTX980 4GB = 165 W & RTX2080 6GB = 160 W, which would be 325 W. I haven't used Intel K CPUs, so I am not that familiar with power usage of that. But I think 850 W would be more than enough, if it is a proper 850 W PSU, even considering power usage by other components like motherboard, RAM, SSD etc.

You can use this to calculate power requirement https://outervision.com/power-supply-calculator

My power usage is AMD Ryzen 5600x (75 W) + RTX3060 (170W) + RTX3090 (350W) = 595 W at max, I think with other components total was 750 W ( System power budget : https://outervision.com/b/8XoZwf ).

I have a 850 W, Tier A - Deepcool PQ850M which is a Seasonic based 80+ Gold. I have power stress tested with OCCT and it was fine.

Oh nice set up. I have thermaltake 850w 80+ gold. Judging by your answer i think my desktop will be okay.