Viewing a single comment thread. View all comments

acutelychronicpanic t1_jeejxes wrote

Morality isn't about people or other beings. Its about what you care about.

People care about people.

An AI could care about anything. Maybe its people, maybe its paperclips.

To it, every day that you and your family aren't paperclips could be a tragedy of immense proportion. Equivalent to watching a city be destroyed.

I think you underestimate just how unrelated intelligence and morality are on a fundamental level. Read on the "orthogonality thesis"

The closest thing to morality that will arise from intelligence is game theory.

1