Viewing a single comment thread. View all comments

rjromero t1_j61ytag wrote

This is incredible research. Finally a lead on how we might get to "true" one shot / few shot learning.

20

currentscurrents OP t1_j62auto wrote

Yes, but I don't want to create too much optimism; meta-learning was also a promising lead when Schmidhuber wrote his PhD thesis.

Honestly, I'm not sure much has changed since then other than we got more compute power. Transformers are reportedly equivalent to 1990s meta-learning networks except that they run better on GPUs, and GPUs have gotten powerful enough to run them at very large scale.

25