Never heard of it before, thank you for the tip.

I found the original tweet, it is a bit explained here: https://twitter.com/danshipper/status/1602126357953142784

He actually used GPT-3 and the way it was adapted to the domain knowledge it was a kind of a smart hack. I think his approach is probably too simplistic to distill knowledge from papers though.

That’s a good suggestion, I forgot about Galactica. I will look into it.