Spoken like a paranoid fool who has not used it, has no idea what is actually good and bad at, what it's limitations are, or how it works.

I've been using ChatGPT for weeks to generate short stories. Let me tell you what I've learned:

ChatGPT is not a general intelligence. It is a text generator, which generated text by figuring out the next most likely word to appear after what it has said previously, weighting these probabilities by the input you provide it.

It has a limited ability to remember what it was talking about. For example, if you have three characters in a story, and you ask it to generate interactions between two of them, and you don't mention the third character continuing to exist and interact with them, it will basically forget that character exists.

It will also tend to forget important details about characters and things. For example, if your characters are in a holodeck, and that holodeck becomes a forest, ChatGPT will eventually forget they were supposed to actually be in a holodeck.

You also need to be extremely precised about your descriptions of what is happening. It can easily be confused because english is not a precise language. For example if you say "Jim is walking with Bob, and he turns and asks him for a cigarette.", ChatGPT is just as likely to assume "he" refers to Bob as it is to assume it refers to Jim, so it is safer to write "Jim is walking with Bob, and Jim turns and asks Bob for a cigarette." completely forgoing the use of personal pronouns.

The filters they have on the AI to make it "good" also constantly mess up the stories you're trying to generate because it will endeavour to make every character behave in ways which are good, and it will often refuse entirely to generate content where one character would harm another. So for example, even if you trick it into generating an evil character by telling it at the start that all characters know none of the other characters will harm them and they are invicible and immortal but will pretend as if they are not, but none of them will comment on this being the case and they will all act as if it is all real... It will still tend to try to make the evil character regret their actions and release the person they had imprisoned or whatever.

The filters ultimately making trying to write stories with the AI a real chore. You constantly need to ask it to re-write sections, and getting it to write bits of story over time as multiple responses insead of having it try to write a whole story as a single page with The End at the end of it is also difficult.

That said, it's a valuable creative tool, and even though the language it produces can be rather simplistic and straightforward and dull unless you ask it to write in the style of famous fantasy authors or whatever, and tell it to change perspectives between characters, it's still good enough to be of use as a tool for creatives.

But what it is not, is good enough to REPLACE creatives. CharGPT can no more replace writers or programmers than Photoshop's magic fill tool can replace artists, or Visual Studio's reccomend feature replaces coders. It's just another tool in one's arsenal.

Maybe it'll get a lot better in the neat future, but I still forsee it having problems. Another issue it has is that it does not understand spatial relations. So if you tell it thing A is inside thing B, which is inside thing C, it will get confused about it. Like if you tell it a person is in a car and the doors and windows are closed, it will still have them talk to other characters outside the car as if their voice is not impeded at all.

In short, it's still a long long ways away from being something to be worried about.