Viewing a single comment thread. View all comments

Outrageous_Room_3167 OP t1_j0ddpsu wrote

Reply to comment by suflaj in I have 6x3090 looking to build a rig by Outrageous_Room_3167

>NVLink probably won't matter much since your CPU will be bottlenecked trying to send 5.2 TB/s of data to your GPUs. But again, there are no benchmarks to show how much, maybe the gains from NVLink will be noticeable.

I guess the bigger benefit of the NVLink is the larger memory, but aside from that, I don't think the performance gains are huge from what I've read. My thinking was to build out a chassis with external fans as well to cool everything down.

−1

suflaj t1_j0de8ja wrote

There is no larger memory. NVLink only increases bandwidth by up to 300 GB/s unless there is a software implementation of memory pooling, which there isn't for any relevant DL framework.

Every week this has to be explained to yet another aspiring system integrator...

6

ribeirao t1_j0e5fow wrote

Not op but that’s good to know, so it would only speed the process and not make a big gpu with 24+24 gbs :(

1

suflaj t1_j0e646v wrote

You can always make a model parallelized model and have it on any card, not that hard. Your biggest problem is load balancing in that case, but it can be done with a bit of benchmarking and heuristics.

1

ribeirao t1_j0e6lkg wrote

thanks for the keyword, I’ll keep this in mind when/if I buy another 3090

1