ChatGPT itself has a very real problem with being confidently wrong, I dont know if the next version will be better but it seems to be an on going problem. Fake news is convincing and AI does not have the intuition to know it is wrong. Look at the twitter bot that turned racist and had to be taken down by microsoft. I know that was a while ago but you can see a similar flaw in chatGPT still.