VitaminD263 t1_iz4w5i9 wrote on December 6, 2022 at 2:36 PM

Reply to comment by baconninja0 in [D] OpenAI’s ChatGPT is unbelievable good in telling stories! by Far_Pineapple770

Yea or you know you could just make up input, let it execute the code and get the output to create your training data...

PromiseChain t1_iz90i6y wrote on December 7, 2022 at 10:45 AM

You’re just demonstrating you don’t understand this technology. This is not piping anything into a terminal anywhere. There is no 3080 that actually got installed by OpenAI to provide this data, they explain their data transparently. This is modeled from stackoverflow answers most likely.

VitaminD263 t1_izb0tz8 wrote on December 7, 2022 at 8:06 PM

I'm not saying that it's using a terminal behind the scenes, I'm saying the data used to train this was likely generated by using an execution environment. There are serious NLP researchers believing this as well: https://twitter.com/yoavgo/status/1599886211656491008