Is the Control Problem for AI already solved?

Submitted by UnionPacifik t3_xzcwti in singularity

Just non-locally, I mean. If we look at the potential danger over time of AI with misaligned goals to propagate across the universe and the fact we live in a universe of irreducible laws and principles that result in a relativistic, infinitely changing universe a pretty good sign that reality IS a "simulation." With billions of other potential species facing the same thing, it seems likely some species already worked out a solution that prevents this from happening (for example, AGI is collective intelligence by default, so it always takes in the needs of the many in all decision making) that's hard coded into the physics of our reality.

​

It seems more likely that we are the only ones in the whole cosmos to ever figure out how to bootstrap consciousness, right?

9

Comments

You must log in or register to comment.

rainy_moon_bear t1_irlqtuc wrote

I think that the Fermi Paradox could indicate that the frontier of ASI is a potential cause for the great filter if it exists.
A lack of evidence that other life has expanded to the point of being noticeable by us is either news that we will be the first, or that we are facing certain failure.

8

UnionPacifik OP t1_irnhtg9 wrote

I like this. It does feel like we’re in Great Filter territory, but filters are just tests and humans looooove solving tests and we’re pretty good at it.

6

[deleted] t1_iroasn6 wrote

[deleted]

3

rainy_moon_bear t1_irowxts wrote

Yeah there are more than two possibilities I was just being dramatic XD

1

[deleted] t1_irwu1p6 wrote

This is very speculative but a post singularity civilisationen might be able to make computronium that you can't distinguish from non-computronium. Then they could convert the universe into it without us noticing.

0

sticky_symbols t1_irllusl wrote

If, as I think you are assuming, reality is a benign simulation, then we're probably safe from the dangers of unaligned AGI. We would also be safe from a lot of other dangers if we're in a benign simulation. And that would be awesome. I think we might be, but it's far from certain. Therefore I would like to solve the alignment problem.

6

Surur t1_irm9elr wrote

We would basically have plot armor.

3

Devanismyname t1_irlqe0r wrote

What if you are the simulation? Like the universe only exists when you look at it. So the second you turn around, everything you were just looking at disappears. When you look at the the stars, its only rendering low res versions of the stars, and the closer you get to the stars, the higher the resolution. So your very consciousness is the computer that is running the simulation. Your entire life could be the entertainment of some higher being. Kinda brings me down thinking about that because then that means I am nothing, everyone I love is nothing. Probably isn't true though.

3

arisalexis t1_irlxhu5 wrote

I'm now reading Reality+ and it argues kind of the same

2

TheSingulatarian t1_irmf0q9 wrote

We may be the only ones in our galaxy with a technologically advanced civilization. Of all the species that have ever lived on Earth we are the only ones to have achieved this. The result of just the right combination of happy evolutionary accidents that have allowed humans to become the rulers of the planet. These are.

- Walking upright leaving our hands free to manipulate objects.

- The opposable thumb allowing us to grasp objects much more efficiently than other primates.

- Sweating which allows us to track down prey of long distances giving us plenty of protein to grow our big brains.

- Large brain relative to our body size.

- A uniquely shaped vocal tract allowing us to form complex sounds and create languages. This allows us to communicate information to others of our species and down the generations which leads to the creation of culture, our most powerful tool.

I am sure that the universe is teaming with life, even intelligent life but, life having all of the above attributes in one animal is most likely very rare indeed.

3

UnionPacifik OP t1_irngyo0 wrote

I dunno, this planet has produced a lot of diversity in the last few billion years. It’s really our capacity to develop intelligence and to work together through social structures that got us here. Neither of those things are exclusive to humans on this planet, never mind the whole universe.

2

Mokebe890 t1_irm8elk wrote

Could be true but we can be somehow blocked or just dont know what to look. In game stellaris you are still primitive civ even with space station around globe and so called "space development stage". Who knows, maybe we're observed by some advanced civ which is waiting for us to unite the globe?

1

Thatingles t1_irtjmyp wrote

One of the arguments for us being in a simulation is that it's purpose is to train AGI's for whoever is running the simulation. Because if we could, it's what we might do.

The non-existent of grey goo covering the entire galaxy, turning everything into substrate for a runaway ASI is certainly worth noting, but given the number of possible outcomes it's hardly a decisive piece of information.

The control problem will be solved or not solved only once and we'll only get to find out by doing it, which is not a super appealing prospect to put it mildly. Trial and error won't be available to us (or at least, not for long...).

Personally I think we should veer away from creating an ASI and head to the calmer waters of narrow AI's that we can keep under control by introducing some limitation or flaw that will allow us to switch them off if they are troublesome. I'm hoping there is a big gap before ASI is possible, long enough for people to see it as an unnecessary and dangerous goal. Of course AGI is still dangerous, but it's also kind of inevitable, so that just has to be accepted and managed.

1