Viewing a single comment thread. View all comments

Hyper1on t1_j43crwx wrote on January 12, 2023 at 9:58 PM

Reply to comment by --algo in [D] Microsoft ChatGPT investment isn't about Bing but about Cortana by fintechSGNYC

That's the InstructGPT paper, which is right for ChatGPT, but Copilot is based on Codex, which does not use RLHF.

--algo t1_j43rpre wrote on January 12, 2023 at 11:33 PM

Are you sure? This implies otherwise: https://openai.com/blog/instruction-following/

But maybe it's only for the non-codex models

Hyper1on t1_j43wyf3 wrote on January 13, 2023 at 12:09 AM

You can see the full details here: https://beta.openai.com/docs/model-index-for-researchers

Copilot itself is the 12B Codex model, with further refinements.