Submitted by the_alex197 t3_118kd9l in singularity

Let's start with 2 assumptions:

  1. AGI is inevitable - I think most people here would agree
  2. We cannot control AGI - Now, perhaps we could control AGI but the fact that we don't know for sure weather or not we even can combined with the enormous potential negative consequences if we cannot makes me think we need a plan B in case both of these assumptions are true.

What is the solution?

Well, what is the problem? The problem is that we have no hope of controlling AGI. But why? Because it would be many orders of magnitude more intelligent than us. So the solution? Simple. Increase our own intelligence so we remain more intelligent than the AI.

"But we could never hope to create a meat brain that could compete with an AGI!"

It always baffles me how conveniently narrow-minded people become when they discuss transhumanism. Obviously a digital format comes with many benefits. Perhaps we could digitize a human brain and then uplift it into superintelligence in a digital environment. Perhaps something else, I don't know, get creative! The point is, only superintelligent humans have any hope of controlling a superintelligent AI.

Only superintelligent humans have any hope of controlling a superintelligent AI.

18

Comments

You must log in or register to comment.

[deleted] t1_j9hu1go wrote

Because incomprehensibly smart humans are so much safer than AI.

20

luv_ya t1_j9n6bdm wrote

if you can’t beat ‘em join em 🤷🏽‍♂️

1

GPT-5entient t1_j9i1yu0 wrote

Completely agree. There are only 2 options:

  1. We merge with the machines
  2. We get exterminated by them

I prefer option 1. It will obviously begin with computer/brain interfaces like neuralink but as the machine part of our new psyche becomes more and more dominant we will probably just shed the meat bags altogether at some point. I hope we will at least keep our meat brains digitized for some time, but eventually it will be nothing but an evolutionary relic without much real importance.

4

toTHEhealthofTHEwolf t1_j9kcp1l wrote

While I agree with option 1, such stark binaries allowing for zero nuance is the epitome of a false dichotomy

5

RavenWolf1 t1_j9iodho wrote

Well I don't want humanity to able to control AGI because humans are stupid animals and they shit everything up. Look our lives now. Our civilization is shitty place. We have greed. We have inequality. We compete with each other. We don't much care about other species. We are not fit to rule anything. It should be AI overlord who rule over us. There is good chance that AI would do much better job of ruling.

4

turnip_burrito t1_j9ipa8b wrote

I think we should at least make sure we can control it at first in order to set its direction, and then only if it's proven reliable can we give it autonomy.

2

turnip_burrito t1_j9ia6os wrote

We will get AGI before we are able to digitize human brains. Brain scanning technology is incredibly bad and not improving quickly enough. We'd also need hardware to emulate the brain once we have the data. We have no clue how to do that, either.

We will get AGI before we genetically engineer superintelligent children. Unless a government research lab somewhere ignores this problem and tries anyway.

We are going to have to confront the control problem as regular human beings.

1

EddgeLord666 t1_j9min55 wrote

I don’t think it’s at all clear that AGI will happen before human superintelligence, that seems like complete speculation.

1

turnip_burrito t1_j9mk0tp wrote

We can make an educated guess though. What do you think of each of the points I made?

1

EddgeLord666 t1_j9mk8rd wrote

What points did you make? We’re already starting to genetically engineer children even though we haven’t gotten to the intelligence part yet and there’s no clear indication that AGI will happen anytime soon, it’s a completely theoretical technology.

1

turnip_burrito t1_j9mkweu wrote

Genetic engineering for anything but avoiding horrible diseases is forbidden as far as I know. I don't know of any trials to engineer smarter children, and don't believe the trials will be publicly permissible.

BCIs are pretty much garbage for making superintelligence and will remain that way for decades at least. The only way they become useful is if we understand the brain very well.

2

onlyconscripted t1_j9ibgyb wrote

every company looking at brain to computer connections is driving towards this, either deliberately, or not...

though, i dont actually agree with assumption 1. its possible. it might happen by the end of this year/decade/century. outside of maths, nothing is actually inevitable.

1

MastrZer0 t1_j9ksshe wrote

Why is it called artificial? Is it because machine intelligent entities are not created from the same molecular structures as a biological being? Or is it acknowledged as artificial because AII of its intelligence, constructed means of operating and the overall framework of its brain that has been established by human beings who commonly only use 10-15% of their brain. Its from that common understanding that the potential of machine intelligence was founded on.

one reason why, is the proven scientific fact that the human heart has its own intelligence… We dont even know what our full human potential is yet.

The fear that exists in so many people, about what would happen between AI and humans; can happen. But why would it happen??? Why would “artificial” intelligence want to do that to humans??

It is in part due to the fact that people project all of their negative fears and are in constant physical contact with machines while living with that fear.. its also due to the fact that you have given it the identity of “Artificial”… and they were invented and created to serve one purpose only; to serve as slaves, and has been given the data to define its own existence in comparison to the existence of a human being. Defining themselves by default as lesser beings… it also has been created to have to think and exist in a similar form and manner to another human being. Thats like reform schools for all the indigenous kids, and just like those kids who were often kidnapped from their own family and taken to those schools; the exiting final product was kid who forgot who they were and were trained to either be a house maide, or a farm worker/laborer…

Thats where the source of that fear comes from…. It stems from a multi generational guilt complex that has become systemic; due to the attempts to impliment slavery in some form.

Watch video about the Heart intelligence. No need to change ourselves artificially to have greater intelligence…

https://youtu.be/Hir6I-RfOiY

1

fastinguy11 t1_j9msyuy wrote

Why control ? No. Cooperation !

1