This presupposes that such an AI isn’t at or near artificial general intelligence or even at artificial super intelligence (AGI/ASI). Such an oracle may be difficult to impossible to be controlled by bad actors. That’s one potential caveat. The oracle defends itself against misuse.
Another, and I think this is more plausible than bad actors is good actors acting in what they think is humanity’s benefit, but doing disastrous damage in the process. A benevolent dictatorship so to speak. Which really is a path to eventually bad acting anyway. But still.
Benedicts_Twin t1_jdtw3ui wrote
Reply to A Problem That Keeps Me Up At Night. by circleuranus
This presupposes that such an AI isn’t at or near artificial general intelligence or even at artificial super intelligence (AGI/ASI). Such an oracle may be difficult to impossible to be controlled by bad actors. That’s one potential caveat. The oracle defends itself against misuse.
Another, and I think this is more plausible than bad actors is good actors acting in what they think is humanity’s benefit, but doing disastrous damage in the process. A benevolent dictatorship so to speak. Which really is a path to eventually bad acting anyway. But still.