There are advances such as quantization that have enabled edge devices to run some pretty spicy models so i wouldn’t be surprised if we got it down to within gaming computers reach pretty soon. Also Google research revealed that GPT-3 was not trained efficiently and has too many parameters. So a newly designed model with way fewer parameters trained on the same data should perform as well as GPT-3.
(I am only a machine learning enthusiast and not an expert so take everything I say with a grain of salt)
StChris3000 t1_iyn5rdm wrote
Reply to [D] What advances need to happen for something like gpt3 to be able to run on consumer devices and laptops locally? Is it even a possibility? by aero_oliver2
There are advances such as quantization that have enabled edge devices to run some pretty spicy models so i wouldn’t be surprised if we got it down to within gaming computers reach pretty soon. Also Google research revealed that GPT-3 was not trained efficiently and has too many parameters. So a newly designed model with way fewer parameters trained on the same data should perform as well as GPT-3.
(I am only a machine learning enthusiast and not an expert so take everything I say with a grain of salt)