Qumeric t1_itywzd3 wrote on October 27, 2022 at 9:50 AM

Reply to comment by manOnPavementWaving in Where does the model accuracy increase due to increasing the model's parameters stop? Is AGI possible by just scaling models with the current transformer architecture? by elonmusk12345_

We don't have enough data and compute to make 5 trillion models economically feasible. It just doesn't make sense. It's better to create 500B model and train it properly.

manOnPavementWaving t1_itz2ds5 wrote on October 27, 2022 at 10:59 AM

I agree, but you'll find yourself to be a stranger in this thread