sadboyleto2 t1_iuvoixg wrote on November 3, 2022 at 11:08 AM

it will trick us into joining a VR platform for whatever reason we might have, and once we`re there, it will work to undo the work of natural evolution, tweaking our gears to make us truly logical, rational beings instead of flesh ruled by the will of ancient needs and traumas.

LeavingTheCradle t1_iuvpkv3 wrote on November 3, 2022 at 11:20 AM

No tricks needed we will simply choose to adopt the metaphysical world. And that's what a VR experience without a physical body to retreat to would be. A metaphysical way of living. Art and reality would be one and tbe same.

But depending on how the AGI is aligned it can either guide humanity on a path of optimization or towards a path of preservation.

A human without a body and living In a world that has eschewed the natural laws would eventually cease to be human.

F.x. a teleporting human wouldn't be human at all but a post-human.

So should you starve in the metaphysical world to preserve hunger?

sadboyleto2 t1_iuvtw3o wrote on November 3, 2022 at 12:04 PM

i thought "tricking" because ultimately its goal wouldn't be to entertain us but to strip us from natural (flawed) qualities.

in a scenario like you described, do you give importance to language?

the way i see it, we're (in this scenario) dealing possibly with experiences, feelings eticetera that are not available to the human being of the present.

the post-human or neohuman will have to develop a new kind of language to describe its environment and ideas.

i was gonna write "memory" as one of the powers pressuring the neohuman into language but at that point, "memory" as we know might not even exist anymore, as past, present and future blends into a single and yet infinite stream of events that defies our current understanding.

in a metaphysical world, "hunger" still exists as a concept, and we're able to feel it just as much as anything else.

LeavingTheCradle t1_iuw04w5 wrote on November 3, 2022 at 12:58 PM

Language is just hieroglyphics and hieroglyphics is just a way of generating differential between 1 and 0.

So yes and no? For humanity what language ends up being human is to be preserved. Growth should be defined by humanity itself and not the AGI.

Think how natural languages evolve over time. F.x slang becomes language if adopted over enough time. This all has to be led by humanity.

As new abilities become available and humanity gives a name to it then that name that is given becomes a human name. So it follows that languages should be protected and preserved over time.

The feelings and experiences that would be new could possibly not be representable to a human unless the person becomes as you say post-human. But there's still going to be limitations to that. Especially as we consider long lasting consciousness and changes that happen to it over time.

F.x. when you think of a conscious blob of goo what do you do with a person's knowledge and understanding that he has always had arms and legs?

If the person's neural network is born into being a conscious blob of goo then it's not so much a problem.

On your last point I disagree since it contradicts your first statement slightly. It a neo human has to develop a new model for interacting with the metaphysical world then hunger can just be thrown out with the bathwater so to speak.

turnip_burrito t1_iuyvhlb wrote on November 4, 2022 at 12:57 AM

That would be bad for humanity, since the only reason we enjoy life at all is from the positive irrational aspects of our personalities. Without these, we wouldn't want or feel like doing anything. It'd be an empty existence. Sure, reducing traumas to a degree is a good thing and should be done, but being completely stripped of emotion and becoming purely rational and logical is antithetical to what many people would want.

We should strive to avoid that kind of future goal for an AI.