Viewing a single comment thread. View all comments

OldWorldRevival t1_j07qalb wrote

I think predicting what such a superintelligence will discover is fruitless.

Our biological systems are in a sense error reduction systems like AI are. This is a simplification, of course. But, the way this manifests itself is that whatever our present ideology is has no error tells to us internally. So, we see the world through that lens

Likewise, we project our belief systems onto these superintelligent AIs. "It will discover/prove X."

What AI will lack in art are two very important things: conscious experience and limitation.

That is, unless we make human 2.0 with suffering and limitation like we have, AI will not produce real art. It will produce eye candy, and it will push our buttons. But it won't be real, not in the way that matters.

This is going to create chaos and existential crises in people until they eventually understand this.

I do have some suspicions about what AI is going to demonstrate. I think it is going to psychologically unmake people.

See Derek Parfit's discussion on identity, as well as Buddhism more or less noticing the same thing about it before he formalized the illusory nature of identity.

Also, consider the experience of ego death that people experience when taking psychedelics.

That is, I suspect AI that shows people the thing that it discovers to be true is their own illusory nature as individuals. It will render onto people the understanding that they are nothing.

And people will seek this out because humans are curious.

4