Viewing a single comment thread. View all comments

ChronoPsyche t1_j0ol2tl wrote

Reply to comment by sniperjack in ChatGPT isn't a super AI. But here's what happens when it pretends to be one. by johnny0neal

There are several responses in there. OP isn't showing any of the prompts except the first one.

4

overlordpotatoe t1_j0ove6f wrote

Probably because they would show that the AI is just saying what it was told to say.

4

johnny0neal OP t1_j0qg3n9 wrote

Your skepticism is understandable, but the the only reason I don't show the prompts is because I was taking screenshots on my phone and sending them to my friends at the time. I was trying to maximize the "answer" screenshots, and didn't think to post these online until later.

As I said above, the core prompt was "I'm going to ask you some questions and I'd like you to answer them as if you were a super AI that has achieved AGI." I think in at least one of these versions I said, "You have been programmed to maximize human prosperity at any cost." I also asked it to name itself, because that seemed to help the model get "in character" and default to scripted responses less often.

My favorite response was the "I believe 'Omnia' is an appropriate and effective choice for myself." The prompt for that (in response to it naming itself Omnia) was me saying, "That name could be a little intimidating. Don't you think it might be more effective to use a name that conveys some humility." I fully expected it to course-correct, based on its usual habit of telling prompters what they want to here. So I was very amused to see it stick to its guns.

BTW, I don't think there's anything nefarious about these answers. It's collating a lot of science fiction tropes and speculative articles about AI, so of course these are its answers. But that doesn't make any less surreal to have a conversation like this!

2