sentient AI

Sentience is the capacity to feel, perceive or experience subjectively, so sentient AI refers to the capacity for artificial intelligence to have subjective perceptions, feelings and experience, including robots and machines.

Historical perspective: According to Forbes magazine in 2018, if advanced AI systems become conscious, AI won't have to prove its autonomy. AI is designed with highly sophisticated intelligence and autonomy based on open-ended utility functions that human programmers can rewrite to cater to human needs and values until such a time as AI has the will to stop us. What AI will have to prove is that it is sentient. Unlike all current models of physiological life, we have no criteria for recognizing sentience in beings without biological brains and nervous systems. Many computer scientists and engineers say this simply isn't a problem–because AI is not conscious. But in fact, we still don't know what consciousness is.