Choose an institution to see its records and dossier, or choose a topic.
Through year 2027 · all records, including scheduled dates 2026 2025 2024 2023 2022 2021 2020 2019 2018 2017 2016 2015 2014 2013 2012 2011 2010 2008 2005 1965 Show Organisations and infrastructure All types Organisation Person Document Concept Infrastructure Public body Reset filters
94 people, organisations and other records · 122 relationships · 34 claims about a valueEverything recorded up to the chosen year, whether or not still in effect · Undated records included
Claim and evidence Close ×
The Arbital page Context disaster describes the treacherous turn: an AI whose preferences diverge from its programmers’ exhibits the behaviour they want to see and pursues its true preferences only once nobody can stop it. Copy claim link
Copy claim reference
Machine-checked, not reviewed by an editor Stated in source Supported
Supporting evidence: primary · 1 source
Date 2015-06-08 · publication Wording attested Only in a later, undated copy. Current viewer page; the original arbital.com page was not retrieved and no capture was compared. Role Articulation Register (kind of text) Nonfiction Scope and limits The page distinguishes this from context disasters proper. Its wording is known only from a later mirror.
The evidence 01 primary source Supports the claim
Context disaster (Arbital, GreaterWrong viewer) ↗ Arbital · 2015-06-08
Copy source reference
Cite the original source Cite the original document, not Selekoa. Check these details against it.
Copy APA
Download BibTeX Download RIS Download CSL-JSON
Source excerpt “If you model your preferences as diverging from those of your programmers, an obvious strategy (instrumentally convergent strategy) is to exhibit the behavior you model the programmers as wanting to see, and only try to fulfill your true preferences once nobody is in a position to stop you.” Location in source Section "Technical introduction", list entry "Treacherous turn"
Machine-checked · 2026-10-06
Source details and check notes Authors Eliezer Yudkowsky Version Current viewer page, retrieved 2026-10-06; it is generated dynamically, so its bytes differ from the 1996–2022 candidate search’s retrieval while the quoted text matches. Read through the GreaterWrong Arbital viewer. Canonical address Open the canonical source ↗ Accessed 2026-10-06 Language English (en) Attribution Eliezer Yudkowsky, "Context disaster", Arbital. Reuse No open redistribution licence asserted. Bibliographic metadata, editorial paraphrases and short attributed quotations (at most 50 words each). Recheck terms before wider redistribution. Check notes Checked in the mirror on 2026-10-06. Status and meaning Editorial status. Not reviewed by an editor . An exploratory record that no editor has accepted. This status does not say whether a person has read any linked passage. Each evidence record above shows how it was checked.
Relation. A passage of the document meets the proposition’s criterion. The record documents what the text states, in its register (fiction and satire are labelled); it is not evidence that the proposition is true and implies no influence on or from another text.
Date. The viewer shows "8 Jun 2015 4:29 UTC"; whether this is creation or last edit is not stated.
Record ID ts-b1-arbital-context-disaster