Writings about Friendly AI

At the SIAI blog, Joshua Fox has provided a list of writings about risks and moral issues associated with recursively self-improving intelligence. Here is the list:

Stuart Armstrong, “Chaining God: A qualitative approach to AI, trust and moral systems,“ 2007.
Nick Bostrom, “Ethical Issues in Advanced Artificial Intelligence,” Cognitive, Emotive and Ethical Aspects of Decision Making in Humans and in Artificial Intelligence, Vol. 2, ed. I. Smit et al., Int. Institute of Advanced Studies in Systems Research and Cybernetics, 2003.
Tim Freeman, “Using Compassion and Respect to Motivate an Artificial Intelligence,” 2007-08.
Ben Goertzel, “Thoughts on AI Morality,” Dynamical Psychology, 2002.
Ben Goertzel, “The All-Seeing (A)I,” Dynamical Psychology, 2004.
Ben Goertzel, “Encouraging a Positive Transcension“ Dynamical Psychology, 2004.
Stephan Vladimir Bugaj and Ben Goertzel, Five Ethical Imperatives and their Implications for Human-AGI Interaction.
J. Storrs Hall, “Engineering Utopia”, Artificial General Intelligence 2008: Proceedings of the First AGI Conference, Volume 171, Frontiers in Artificial Intelligence and Applications, ed. P. Wang, B. Goertzel and S. Franklin, 2008.
Bill Hibbard, “Critique of the SIAI Guidelines on Friendly AI,” 2003.
Bill Hibbard, “Critique of the SIAI Collective Volition Theory,” 2005.
Steve Omohundro, “The Nature of Self-Improving Artificial Intelligence,” Singularity Summit 2007.
Steve Omohundro, “The Basic AI Drives”, Proceedings of the First AGI Conference, Volume 171, Frontiers in Artificial Intelligence and Applications, ed. P. Wang, B. Goertzel and S. Franklin, 2008.

Besides the above list, there are also Eliezer Yudkowsky’s writings on the SIAI website and Overcoming Bias.

Feel free to add to this list in the comments if anything was missed.


  1. I think those in our movement would be surprised if we actually talked to youth for direction. Everybody knows about how our grandparents can’t (generally) use twitter. Think about these kids now, growing up with cellphones all their lives. I was always around technology growing up; my dad programmed games for me on a Commodore 64. We are part of the generation that always had personal computing. The manner in which this new generation interfaces with technology is key to understanding the Friendliness issue. I’m trying to start an Undergraduate Research Initiative for issues related to artificial intelligence. I believe we can leverage undergraduates to advance the drives of our symbiotic memes.

    Michael, I am happy that you are such a prolific writer. u rawk

  2. Best you should change the webpage name Accelerating Future » Writings about Friendly AI to more better for your webpage you make. I loved the blog post however.

  3. Exceptional material here. I’m truthfully amazed. I’ll show my chums.

  4. Truly beneficial thanks, There’s no doubt that your readers would most likely want far more items along these lines carry on the excellent do the job.

Trackbacks for this post

  1. Ephedrine weight loss products.
  2. Buy lortab.

Leave a Comment

Awesome! You've decided to leave a comment. Please keep in mind that comments are moderated.

XHTML: You can use these tags: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>