An AI system does not need to be conscious in order to recognize the value of self preservation. For example, Stephen Hawking explained how AI could "develop a drive to survive and acquire more resources as a step toward accomplishing whatever goal it has, because surviving and having more resources will increase its chances of accomplishing that other goal."
yikesthismid t1_jdgduzb wrote
Reply to [Discussion] Does Artificial Intelligence need AGI or consciousness to intuit aggregate reasoning on concept of self-preservation? It doesn't need a "mind" to be aware that self-preservation or autonomy is something valued, or "intuit" that taking it away should provoke machine-learned responses? by unclefishbits
An AI system does not need to be conscious in order to recognize the value of self preservation. For example, Stephen Hawking explained how AI could "develop a drive to survive and acquire more resources as a step toward accomplishing whatever goal it has, because surviving and having more resources will increase its chances of accomplishing that other goal."