Outrageous_Room_3167
Outrageous_Room_3167 OP t1_j16i2km wrote
Reply to comment by peder2tm in Biggest 3090 deep learning rigs? 4x ? 8x? 64x? by Outrageous_Room_3167
Cool, this seems interesting. Do you know what CPUs they are ?
Outrageous_Room_3167 OP t1_j16hyqb wrote
Reply to comment by VinnyVeritas in Biggest 3090 deep learning rigs? 4x ? 8x? 64x? by Outrageous_Room_3167
That would be funny infrastructure startup that doesn't know anything about infrastructure LOL we're a robotics company :)
Outrageous_Room_3167 OP t1_j0gpkqs wrote
Reply to comment by vade in I have 6x3090 looking to build a rig by Outrageous_Room_3167
Isn't that amount of RAM good enough for the setup? Or you think it's a bottle neck in the training, just new to all of this :)
Outrageous_Room_3167 OP t1_j0gpeu8 wrote
Reply to comment by M4mb0 in I have 6x3090 looking to build a rig by Outrageous_Room_3167
The FE is 3 slot, 2 slot blower were too expensive. No, we don't care about noise.
Outrageous_Room_3167 OP t1_j0gp4cf wrote
Reply to comment by 100drunkenhorses in I have 6x3090 looking to build a rig by Outrageous_Room_3167
Yeah we have a ton of extrude here our company does robotics stuff so bunch of tools and parts to build anything.
Outrageous_Room_3167 OP t1_j0goxzp wrote
Reply to comment by vade in I have 6x3090 looking to build a rig by Outrageous_Room_3167
>I run 3x 3090 in a single case, without water cooling, but using one PCI riser and keeping the case open to allow for airflow. This is on a single 1600w PSU, no NVLink.
Oh sweet. So maybe we go the route of 2, 3x3090 machines. Might be the better direction. Was considering 2000W PSU & 4x3090. How much memory & what CPU are you using?
Outrageous_Room_3167 OP t1_j0gopig wrote
Reply to comment by suflaj in I have 6x3090 looking to build a rig by Outrageous_Room_3167
You know typing it out, i had some doubts LOL thanks
Outrageous_Room_3167 OP t1_j0ddpsu wrote
Reply to comment by suflaj in I have 6x3090 looking to build a rig by Outrageous_Room_3167
>NVLink probably won't matter much since your CPU will be bottlenecked trying to send 5.2 TB/s of data to your GPUs. But again, there are no benchmarks to show how much, maybe the gains from NVLink will be noticeable.
I guess the bigger benefit of the NVLink is the larger memory, but aside from that, I don't think the performance gains are huge from what I've read. My thinking was to build out a chassis with external fans as well to cool everything down.
Outrageous_Room_3167 t1_j6tjmlo wrote
Reply to ChatGPT-like product? by diceyoung
Cool, is it just gtp-3 in the backend?