Viewing a single comment thread. View all comments

Flag_Red t1_iv4h3kz wrote on November 5, 2022 at 5:49 AM

Reply to comment by learn-deeply in [D] NVIDIA RTX 4090 vs RTX 3090 Deep Learning Benchmarks by mippie_moe

I'm super hyped for fp8 support in CUDA. Combined with some other techniques it could put LLM inference (GPT-175B, for example) in reach of consumer hardware.