Bostrom's paper of 2003, in its revised version on the author's site, argues that an agent with a definite top goal would generally find it irrational to change that goal, since changing it would make the goal less likely to be attained.
One recorded claim. The claim panel gives its qualification, the source passages with their place in each source, and how it was checked.
What it connects
Ethical Issues in Advanced Artificial Intelligence → bears on → Instrumental convergence