OpenAI got a free army of QA testers spending hours to make ChatGPT generate offensive and nsfw content. Just because it was really fun. So they got a lot of valuable human-in-the-loop data out of this, which will help them to develop their LLMs further