An AGI Modifying Its Utility Function in Violation of the Orthogonality Thesis
A preprint by James D. Miller, Roman Yampolskiy and Olle Häggström, arXiv, dated 28 January 2020. The PDF is headed 'January 28, 2020'; arXiv v1 was submitted 31 January 2020.
- Issued by
- No issuing record yet. A missing record is a gap in coverage.
- Authors credited
- No authorship claim recorded yet. The source record lists James D. Miller, Roman Yampolskiy and Olle Häggström.
- Dates
- No date claim recorded yet. The source record gives the publication date as 2020-01-28.
- Exact source
- An AGI Modifying Its Utility Function in Violation of the Orthogonality Thesis arXiv (2003.00812v1) · published 2020-01-28 · Retrieved for the candidate pack on 2026-10-29 (SHA-256 9f00e3b9849305adcd2679384f10762570df36d43ea5e841e8ac5428382c7d11). arXiv v1 (submitted 31 January 2020), headed 'January 28, 2020'.
Appears in
- Arguments about catastrophic risk from advanced AI →1 record on this document
Versions
No other versions of this document are recorded. The evidence applies to the source version listed above. Other versions, such as a preprint, working paper or journal publication, are not identified or substituted.
Documentary relations
Each relation is listed separately. Citing, crediting and reporting the use of a method are different acts, and none of them shows agreement or influence by itself.
Contests · 1
Propositions a passage of this document disputes, or a premise they depend on.
- Orthogonality of intelligence and goalsMiller, Yampolskiy and Häggström's paper of 28 January 2020 argues that an AGI might have an instrumental drive to modify its utility function under game-theoretic pressure, which would conflict with the orthogonality thesis, and that AGIs in highly competitive environments might converge to nearly the same utility function.2020-01-28 · publication · Stated in source · Supported Inspect claim & evidence ↗Orthogonality of intelligence and goals: propositions page →
Not recorded for this document: cites · cited by · explicitly credits · reports using a method from · method reported as used by · applies parts of · parts applied by · discusses · reports evaluation of. A missing record does not show that the relation does not exist.