Anthropic's Jack Clark on AI progressSubmitted by Impressive-Injury-91 t3_1118hkt in singularity
Villad_rock t1_j8dxtcr wrote
Reply to comment by genericrich in Anthropic's Jack Clark on AI progress by Impressive-Injury-91
Thought google invented transformers?
PrivateUser010 t1_j8e0iai wrote
Google invented Transformers. It was released in 2015 I think. It was the first model focusing on massive attention mechanisms.
SoylentRox t1_j8e72bz wrote
2017...
Everything that mattered was the last few years. The previous stuff didn't work well enough.
savedposts456 t1_j8isobq wrote
Exactly. Attention is All You Need.
Viewing a single comment thread. View all comments