Viewing a single comment thread. View all comments

chuanli11 t1_ivhsvnf wrote on November 8, 2022 at 1:46 AM

Reply to comment by whata_wonderful_day in [D] NVIDIA RTX 4090 vs RTX 3090 Deep Learning Benchmarks by mippie_moe

BERT large did scales less well for 2x4090. You can find the exact numbers here:
https://github.com/lambdal/deeplearning-benchmark/blob/22.09-py3/pytorch/pytorch-train-throughput-fp32.csv
https://github.com/lambdal/deeplearning-benchmark/blob/22.09-py3/pytorch/pytorch-train-throughput-fp16.csv

whata_wonderful_day t1_ivjbsv1 wrote on November 8, 2022 at 11:50 AM

Thanks! Good to see a 78% bump in performance with 1 GPU at least