Submitted by EducationalCicada t3_10vgrff in MachineLearning
keepthepace t1_j7jgm75 wrote
Reply to comment by telebierro in [N] Google: An Important Next Step On Our AI Journey by EducationalCicada
Google has been the biggest team player when it comes to publish advances in AI. OpenAI has been the worst: AI research paper of big players.
Most of the techs that made ChatGPT possible were published by Google. Worse: OpenAI does not publish the 1% of things that makes ChatGPT unique (though we know enough to have a pretty good idea of what they did).
I'd be whiny in their place as well. The GPT family is not super innovative, they just ran away with an architecture mostly made by Google (Transformers/BERT), stripped it of everything that prevented huge parallelization (which many suspect included things that would allow it to stay "grounded" in reality) and slapped more compute on it.
Viewing a single comment thread. View all comments