Choose an institution to see its records and dossier, or choose a topic.
Through year 2027 · all records, including scheduled dates 2026 2025 2024 2023 2022 2021 2020 2019 2018 2017 2016 2015 2014 2013 2012 2011 2010 2008 2005 1965 Show Organisations and infrastructure All types Organisation Person Document Concept Infrastructure Public body Reset filters
94 people, organisations and other records · 122 relationships · 34 claims about a valueEverything recorded up to the chosen year, whether or not still in effect · Undated records included
Claim and evidence Close ×
The post “AGI Ruin: A List of Lethalities” (2022-06-05) contests Y01. States that an agent pursuing almost any goal has a reason to avoid being shut down, and that MIRI's attempts to formalise an agent that permits shutdown without seeking it failed. Part of a numbered list answering arguments that AGI would be survivable. Copy claim link
Copy claim reference
Machine-checked, not reviewed by an editor Stated in source Supported
Supporting evidence: primary · 1 source
Date 2022-06-05 · publication Role Contesting Register (kind of text) Nonfiction Engagement Engages a premise. Under the message-level rule, the passage, read with the paragraph, message or dialogue turn it belongs to, gives a reason against the premise that a capable goal-directed system will not act to prevent its own shutdown or modification, and a shutdown or correction mechanism can simply be added to it. Scope and limits Premise addressed: A capable goal-directed system will not act to prevent its own shutdown or modification, and a shutdown or correction mechanism can simply be added to it. The inner quotation is a stock phrase in the field; the item does not attribute it.
The evidence 01 primary source Supports the claim
AGI Ruin: A List of Lethalities ↗ LessWrong and Alignment Forum · 2022-06-05
Archived copy, captured 2022-06-05: AGI Ruin: A List of Lethalities ↗
Copy source reference
Cite the original source Cite the original document, not Selekoa. Check these details against it.
Copy APA
Download BibTeX Download RIS Download CSL-JSON
Source excerpt “We (MIRI) tried and failed to find a coherent formula for an agent that would let itself be shut down (without that agent actively trying to get shut down).” Location in source AGI Ruin: A List of Lethalities, Section B.2, item 23
Machine-checked · 2026-10-06
Source details and check notes Authors Eliezer Yudkowsky Version Text checked in the post’s first stored version through the LessWrong GraphQL API on 2026-10-06. Canonical address Open the canonical source ↗ Accessed 2026-10-06 Language English (en) Archive copy Open archived copy, captured 2022-06-05: AGI Ruin: A List of Lethalities ↗ . Captured on the recorded publication date. An archive copy shows only what the archive retrieved on 2022-06-05. It does not prove what the page said earlier, and it can differ from the copy checked on 2026-10-06.Attribution Eliezer Yudkowsky, "AGI Ruin: A List of Lethalities", LessWrong and Alignment Forum, 2022-06-05. Reuse No open redistribution licence asserted. Bibliographic metadata, editorial paraphrases and short attributed quotations (at most 50 words each). Recheck terms before wider redistribution. Check notes Candidate pack passage T01-c. The quotation (49 words) matched the retrieved expression (SHA-256 b36f38a6fd1020bfbd7b9d941e150ea68561242f3a41a0b8f2a56b853a9a6db3) when checked on 2026-10-06. It also matched the posting-day version 1.0.0. Pack version note: edited post, current version 1.3.0; posting-day check pending. The dataset already quotes this source for the human-thought collection; together the quotations would exceed the per-document quotation limit. Shortened to the second sentence of the pack's quotation; the first is paraphrased in the record's statement. Status and meaning Editorial status. Not reviewed by an editor . An exploratory record that no editor has accepted. This status does not say whether a person has read any linked passage. Each evidence record above shows how it was checked.
Relation. A passage of the document disputes the proposition or a premise it depends on. The record documents the text’s position, not who is right.
Date. LessWrong postedAt.
Record ID yk-y01-agi-ruin-2022-c