Matt Mahoney has written “A Model for Recursively Self-Improving Programs”.

One of the interesting challenges in self-improving AI is that current decision theory models lack features for helping decision makers change the way they make decisions, or incorporate models of themselves into decision-making.