Adversarial Attitude
From the SL4 Lexicon:
Adversarial Attitude:
The complex of beliefs and expectations that causes us to expect that AIs will behave anthropomorphically and hostilely. The Adversarial Attitude predisposes us to fear self-improvements by the AI rather than surfing the tide; the Adversarial Attitude causes us to fear the ability of the AI to comprehend and modify Friendliness, rather than regarding comprehension and improvement as the keys to self-improving Friendliness. The Adversarial Attitude predisposes us to expect failures that are human-likely rather than those that are actually most probable or worrisome. The Adversarial Attitude is the opposite of Unity of Will and does not permit us to cooperate with the AI. It leads us to try and enslave or cripple the AI; to build a tool, or a servant, rather than a Friendly but independent Martin Luther King. It leads us to try and reinforce patchwork safeguards with meta-safeguards instead of building coherent Goal Systems Yudkowsky01. See also Asimov Laws, Friendliness, Friendly AI, Friendship Architecture.