What is Friendly AI? From the glossary of Creating Friendly AI:
Friendly AI: 1: The field of study concerned with the production of human-benefiting, non-human-harming actions in Artificial Intelligence systems that have advanced to the point of making real-world plans in pursuit of goals. The term “Friendly AI” was chosen not to imply a particular internal solution, such as duplicating the human friendship instincts, but rather to embrace any set of external behaviors that a human would call “friendly”. In this sense, “Friendly AI” can be used as an umbrella term for multiple design methodologies. Usage: “The field of Friendly AI.”
2: An AI which was designed to be Friendly. Within the context of Creating Friendly AI, an AI having the architectural features and content described in this document. Usage: “A Friendly AI would have probabilistic supergoals.”
3: Friendly AI: An AI which is currently Friendly. See Friendliness. Usage: “The first AI to undergo a hard takeoff had better be a Friendly AI.”
And what, what, one might ask, is Friendliness?
Friendliness: Intuitively: The set …