I found the original tweet, it is a bit explained here: https://twitter.com/danshipper/status/1602126357953142784

He actually used GPT-3 and the way it was adapted to the domain knowledge it was a kind of a smart hack. I think his approach is probably too simplistic to distill knowledge from papers though.