Submitted by mippie_moe t3_ym5b6h in MachineLearning
chuanli11 t1_ivhkx9p wrote
Reply to comment by learn-deeply in [D] NVIDIA RTX 4090 vs RTX 3090 Deep Learning Benchmarks by mippie_moe
Hey, Thanks for the comment. We made sure each GPU uses x16 PCIe 4.0 lanes. It is data parallel (PyTorch DDP specifically).
We look forward to the FP8/CUDA 12 update too.
learn-deeply t1_ivimog5 wrote
Thanks for the additional details.
Viewing a single comment thread. View all comments