Choose an institution to see its records and dossier, or choose a topic.
Through year 2027 · all records, including scheduled dates 2026 2025 2024 2023 2022 2021 2020 2019 2018 2017 2016 2015 2014 2013 2012 2011 2010 2008 2005 1965 Show Organisations and infrastructure All types Organisation Person Document Concept Infrastructure Public body Reset filters
94 people, organisations and other records · 122 relationships · 34 claims about a valueEverything recorded up to the chosen year, whether or not still in effect · Undated records included
Claim and evidence Close ×
Grace’s summary of 2014-11-25 states the treacherous turn as: while weak, an AI behaves cooperatively, and when strong enough to be unstoppable it pursues its own values. Copy claim link
Copy claim reference
Machine-checked, not reviewed by an editor Stated in source Supported
Supporting evidence: primary · 1 source
Date 2014-11-25 · publication Role Articulation Register (kind of text) Relay of another author Scope of the passage A summary of Bostrom’s formulation. Scope and limits A reading-group summary of chapter 8 of Bostrom’s Superintelligence (2014), citing its p. 119: primary for Grace’s summary, secondary for Bostrom’s formulation. The book was not retrieved for this collection.
The evidence 01 primary source Supports the claim
Superintelligence 11: The treacherous turn ↗ LessWrong · 2014-11-25
Archived copy, captured 2018-06-12: Superintelligence 11: The treacherous turn ↗
Copy source reference
Cite the original source Cite the original document, not Selekoa. Check these details against it.
Copy APA
Download BibTeX Download RIS Download CSL-JSON
Source excerpt “The treacherous turn: while weak, an AI behaves cooperatively. When the AI is strong enough to be unstoppable it pursues its own values.” Location in source Section "Summary", bullet citing p. 119 of Superintelligence
Machine-checked · 2026-10-06
Source details and check notes Authors Katja Grace Version Text checked in the post’s first stored version through the LessWrong GraphQL API on 2026-10-06; content version 1.0.0. Canonical address Open the canonical source ↗ Accessed 2026-10-06 Language English (en) Archive copy Open archived copy, captured 2018-06-12: Superintelligence 11: The treacherous turn ↗ . Captured 1295 days after the recorded publication date. An archive copy shows only what the archive retrieved on 2018-06-12. It does not prove what the page said earlier, and it can differ from the copy checked on 2026-10-06.Attribution Katja Grace, "Superintelligence 11: The treacherous turn", LessWrong, 2014-11-25. Reuse No open redistribution licence asserted. Bibliographic metadata, editorial paraphrases and short attributed quotations (at most 50 words each). Recheck terms before wider redistribution. Check notes Checked against the first stored version on 2026-10-06. Status and meaning Editorial status. Not reviewed by an editor . An exploratory record that no editor has accepted. This status does not say whether a person has read any linked passage. Each evidence record above shows how it was checked.
Relation. A passage of the document meets the proposition’s criterion. The record documents what the text states, in its register (fiction and satire are labelled); it is not evidence that the proposition is true and implies no influence on or from another text.
Date. Posting time 2014-11-25T02:00:06Z.
Record ID ts-b1-grace-2014-treacherous-turn