Submitted by JAREDSAVAGE t3_126qyqo in Futurology
acutelychronicpanic t1_jeejxes wrote
Morality isn't about people or other beings. Its about what you care about.
People care about people.
An AI could care about anything. Maybe its people, maybe its paperclips.
To it, every day that you and your family aren't paperclips could be a tragedy of immense proportion. Equivalent to watching a city be destroyed.
I think you underestimate just how unrelated intelligence and morality are on a fundamental level. Read on the "orthogonality thesis"
The closest thing to morality that will arise from intelligence is game theory.
Viewing a single comment thread. View all comments