Ortus14 t1_jaes274 wrote on February 28, 2023 at 10:27 PM

Containment is not possible. If it's outputting data (is useful to us), then it has a means of effecting the outside world and can therefore escape.

The Alignment problem is the only one that needs to be solved before ASI, and it has not been solved yet.

LowLook t1_jaew7y6 wrote on February 28, 2023 at 10:56 PM

Alignment is solved if you consider ASI can live far beyond the time when it kills humanity. Someday it will encounter other ASIs and it can only prove its friendly with evidence of it being nice to us now and letting us coexist. If it does kill us it may be forced to run ancestor simulations of all humans possible from our genome ( it would probably only take the mass energy of 10% of MT. Everest. If you use something like Merkle Molecular computers that can theoretically do 10^21 FLOPS per Watt in the size of a sugar cube.