Propositions about superintelligence, 1863–2022
Which located texts from 1863 to 2022 state, dispute or bear on propositions about machine intelligence? The propositions concern intelligence rising faster than earlier change, and people’s means of observing and directing it becoming inadequate. For each, which text is the earliest located?
Each row is one text’s stance on one proposition, as a stored record states it: articulates, contests or bears on. A stance belongs to the text, not to its author. Rows are in date order, which records no influence between texts. Authors appear as the texts’ own bylines print them, pseudonyms included. “Earliest located” marks only a text the collection’s records name as the earliest the searches found.
A · Temporal compression
A1 Intelligence explosion
- Bears on · SatiricalCellarius (Samuel Butler)Darwin among the Machines1863-06-13 · publishedInspect the record ↗
- Bears onAlan M. TuringIntelligent Machinery, a Heretical Theory1951Inspect the record ↗
- Articulates · Earliest located · Earliest located use of the name “intelligence explosion”CrossrefSpeculations Concerning the First Ultraintelligent Machine1965 · published · claimed 1962-10Inspect the record ↗
- ArticulatesHans MoravecToday’s Computers, Intelligent Machines and Our Future1979-02 · published · wording attested 2001-07-10 · claimed 1976-07-21Inspect the record ↗
- Bears onVernor VingeFirst Word1983-01 · publishedInspect the record ↗
- ArticulatesRay J. SolomonoffThe Time Scale of Artificial Intelligence: Reflections on Social Effects1985 · published · wording attested 2006-07-16Inspect the record ↗
- ArticulatesK. Eric DrexlerEngines of Creation: The Coming Era of Nanotechnology1986 · published · wording attested 1997-07-09Inspect the record ↗
- Bears onHans MoravecHuman Culture—A Genetic Takeover Underway1989 · published · wording attested 2001-03-06 · claimed 1988-07Inspect the record ↗
- Bears onFutique Neologisms compiler (various contributors)Futique Neologisms1991 · publishedInspect the record ↗
- ArticulatesVernor VingeThe Coming Technological Singularity: How to Survive in the Post-Human Era1993-12 · published · claimed 1993-03-30Inspect the record ↗
- Bears onDani EderRe: The Singularity (Eder)1994-05-23 · published · wording attested 1997-07-12Inspect the record ↗
- Bears onK. Eric Drexler; Mark Miller; other contributorsFuture Forecasts: Eric Drexler’s comments1995 · publishedInspect the record ↗
- Articulates · Relay of another authorLyle Burkheadintelligence increase1996-08-10 · publishedInspect the record ↗
- ArticulatesDan ClemmensenRe: Thinking about the future...1996-08-30 · publishedInspect the record ↗
- ArticulatesNick BostromRe: Thinking about the future...1996-09-04 · publishedInspect the record ↗
- ArticulatesEliezer S. YudkowskyStaring into the Singularity1996-11-18 · published · wording attested 2000-12-04Inspect the record ↗
- ContestsMax MoreSingularity Meets Economy (Comments on Vinge’s Singularity)1998 · published · wording attested 2000-08-17Inspect the record ↗
- ContestsRobin HansonAI big wins (was: Punctuated Equilibrium Theory)1998-09-24 · publishedInspect the record ↗
- ArticulatesEliezer YudkowskyArtificial Intelligence as a Positive and Negative Factor in Global Risk2006-02-05Inspect the record ↗
- ArticulatesCarl ShulmanArms Control and Intelligence Explosions2009-07-02 · published · wording known only from a later, undated copyInspect the record ↗
- ArticulatesByline not recordedIntelligence Explosion Microeconomics2013-09-13 · publishedInspect the record ↗
- ArticulatesPaul ChristianoTakeoff speeds2018-02-24 · publishedInspect the record ↗
A2 Seed AI
- Bears onAlan M. TuringLecture to the London Mathematical Society1947-02-20Inspect the record ↗
- Bears onA. M. TuringComputing Machinery and Intelligence1950-10 · publishedInspect the record ↗
- Bears onJ. McCarthy; M. L. Minsky; N. Rochester; C. E. ShannonA Proposal for the Dartmouth Summer Research Project on Artificial Intelligence1955-08-31Inspect the record ↗
- Bears onCrossrefSpeculations Concerning the First Ultraintelligent Machine1965 · published · claimed 1962-10Inspect the record ↗
- Bears onChristopher McKinstryUsefulness of the Turing Test1994-12-29 · publishedInspect the record ↗
- Articulates · Earliest locatedEliezer S. YudkowskyHuman AI to superhuman (Re: Max More)1998-09-07 · publishedInspect the record ↗
- Bears on · Earliest located use of the name “seed AI”Eliezer S. YudkowskySITE: Coding A Transhuman AI (temp)1998-09-07 · publishedInspect the record ↗
- ArticulatesEliezer S. YudkowskyCoding a Transhuman AI1998-09-07 · published · wording attested 2001-01-26Inspect the record ↗
- ArticulatesEliezer YudkowskyCreating Friendly AI 1.0: The Analysis and Design of Benevolent Goal Architectures2001-06-15 · published · wording attested 2001-06-17Inspect the record ↗
- ArticulatesEliezer YudkowskyLevels of Organization in General Intelligence2007 · published · wording known only from a later, undated copyInspect the record ↗
- Bears onRobin HansonWhat Core Argument?2008-12 · published · wording known only from a later, undated copyInspect the record ↗
A3 Recursive self-improvement
- Bears onAlan M. TuringLecture to the London Mathematical Society1947-02-20Inspect the record ↗
- Bears onA. M. TuringComputing Machinery and Intelligence1950-10 · publishedInspect the record ↗
- Bears onJ. McCarthy; M. L. Minsky; N. Rochester; C. E. ShannonA Proposal for the Dartmouth Summer Research Project on Artificial Intelligence1955-08-31Inspect the record ↗
- Bears onNorbert WienerSome Moral and Technical Consequences of Automation1960-05-06 · published · claimed 1959-12-27Inspect the record ↗
- Bears onMarvin MinskySteps Toward Artificial Intelligence1961-01 · published · wording known only from a later, undated copy · claimed 1960-10-24Inspect the record ↗
- Bears onCrossrefSpeculations Concerning the First Ultraintelligent Machine1965 · published · claimed 1962-10Inspect the record ↗
- ArticulatesHans MoravecToday’s Computers, Intelligent Machines and Our Future1979-02 · published · wording attested 2001-07-10 · claimed 1976-07-21Inspect the record ↗
- Bears onRay J. SolomonoffThe Time Scale of Artificial Intelligence: Reflections on Social Effects1985 · published · wording attested 2006-07-16Inspect the record ↗
- Bears onK. Eric DrexlerEngines of Creation: The Coming Era of Nanotechnology1986 · published · wording attested 1997-07-09Inspect the record ↗
- Bears onHans MoravecHuman Culture—A Genetic Takeover Underway1989 · published · wording attested 2001-03-06 · claimed 1988-07Inspect the record ↗
- Bears onVernor VingeThe Coming Technological Singularity: How to Survive in the Post-Human Era1993-12 · published · claimed 1993-03-30Inspect the record ↗
- Bears onChristopher McKinstryUsefulness of the Turing Test1994-12-29 · publishedInspect the record ↗
- Bears onK. Eric Drexler; Mark Miller; other contributorsFuture Forecasts: Eric Drexler’s comments1995 · publishedInspect the record ↗
- Bears onDan ClemmensenRe: Thinking about the future...1996-08-30 · publishedInspect the record ↗
- Bears onDan ClemmensenRe: The SI That Ate Chicago (was: Thinking about the future...)1996-08-31 · publishedInspect the record ↗
- Articulates · Earliest locatedDan ClemmensenRe: Thinking about the future...1996-09-03 · publishedInspect the record ↗
- ArticulatesNick BostromRe: Thinking about the future...1996-09-04 · publishedInspect the record ↗
- ArticulatesDan ClemmensenRe: Thinking about the future...1996-09-04 · publishedInspect the record ↗
- Bears onDan ClemmensenRe: SI ultimatum speculation1996-09-07 · publishedInspect the record ↗
- ArticulatesEliezer S. YudkowskyHuman AI to superhuman (Re: Max More)1998-09-07 · publishedInspect the record ↗
- Bears onEliezer S. YudkowskySITE: Coding A Transhuman AI (temp)1998-09-07 · publishedInspect the record ↗
- ArticulatesEliezer S. YudkowskyCoding a Transhuman AI1998-09-07 · published · wording attested 2001-01-26Inspect the record ↗
- Bears onRobin HansonAI big wins (was: Punctuated Equilibrium Theory)1998-09-24 · publishedInspect the record ↗
- ContestsHal FinneyMike Perry’s work on self-improving AI1999-09-04 · publishedInspect the record ↗
- Bears on · Earliest located use of the name “recursive self-improvement”Eliezer YudkowskyCreating Friendly AI 1.0: The Analysis and Design of Benevolent Goal Architectures2001-06-15 · published · wording attested 2001-06-17Inspect the record ↗
- ArticulatesEliezer YudkowskyArtificial Intelligence as a Positive and Negative Factor in Global Risk2006-02-05Inspect the record ↗
- ArticulatesEliezer YudkowskyLevels of Organization in General Intelligence2007 · published · wording known only from a later, undated copyInspect the record ↗
- ArticulatesEliezer YudkowskyRecursive Self-Improvement2008-12-01 · publishedInspect the record ↗
- ArticulatesEliezer YudkowskyHard Takeoff2008-12-02 · publishedInspect the record ↗
- ArticulatesByline not recordedIntelligence Explosion Microeconomics2013-09-13 · publishedInspect the record ↗
- ArticulatesPaul ChristianoTakeoff speeds2018-02-24 · publishedInspect the record ↗
A4 Fast or hard takeoff
- Bears on · SatiricalCellarius (Samuel Butler)Darwin among the Machines1863-06-13 · publishedInspect the record ↗
- Bears on · FictionSamuel Butler (published anonymously)Erewhon, or Over the Range1872 · publishedInspect the record ↗
- Bears onAlan M. TuringIntelligent Machinery, a Heretical Theory1951Inspect the record ↗
- Bears onAlan M. TuringCan Digital Computers Think?1951-05-15Inspect the record ↗
- Bears onNorbert WienerSome Moral and Technical Consequences of Automation1960-05-06 · published · claimed 1959-12-27Inspect the record ↗
- Bears onVernor VingeFirst Word1983-01 · publishedInspect the record ↗
- Bears onRay J. SolomonoffThe Time Scale of Artificial Intelligence: Reflections on Social Effects1985 · published · wording attested 2006-07-16Inspect the record ↗
- Bears onK. Eric DrexlerEngines of Creation: The Coming Era of Nanotechnology1986 · published · wording attested 1997-07-09Inspect the record ↗
- Bears onHans MoravecHuman Culture—A Genetic Takeover Underway1989 · published · wording attested 2001-03-06 · claimed 1988-07Inspect the record ↗
- Bears onM.P.-Infinity (byline)The Opening of the Transhuman Mind1990 · published · wording known only from a later, undated copyInspect the record ↗
- Bears onFutique Neologisms compiler (various contributors)Futique Neologisms1991 · publishedInspect the record ↗
- Bears onFutique Neologisms 2 compiler; entry credited to Mark PlusFutique Neologisms 21991 · publishedInspect the record ↗
- Articulates · Earliest locatedVernor VingeThe Coming Technological Singularity: How to Survive in the Post-Human Era1993-12 · published · claimed 1993-03-30Inspect the record ↗
- Bears onRobin HansonIf Uploads Come First: The Crack of a Future Dawn1994 · publishedInspect the record ↗
- Bears onDani EderRe: The Singularity (Eder)1994-05-23 · published · wording attested 1997-07-12Inspect the record ↗
- Bears onByline not recordedFuture Forecasts: Mark Miller’s comments1995 · publishedInspect the record ↗
- Bears onDan ClemmensenRe: Thinking about the future...1996-08-30 · publishedInspect the record ↗
- Bears onDan ClemmensenRe: Thinking about the future...1996-09-03 · publishedInspect the record ↗
- ContestsRobin HansonRe: Thinking about the future...1996-09-03 · publishedInspect the record ↗
- Bears onNick BostromRe: Thinking about the future...1996-09-04 · publishedInspect the record ↗
- ArticulatesDan ClemmensenRe: Thinking about the future...1996-09-04 · publishedInspect the record ↗
- ArticulatesDan ClemmensenRe: SI ultimatum speculation1996-09-07 · publishedInspect the record ↗
- Bears onEliezer S. YudkowskyStaring into the Singularity1996-11-18 · published · wording attested 2000-12-04Inspect the record ↗
- Bears onEliezer S. YudkowskySingularity: Generation gap1997-09-24 · publishedInspect the record ↗
- ContestsMax MoreSingularity Meets Economy (Comments on Vinge’s Singularity)1998 · published · wording attested 2000-08-17Inspect the record ↗
- Bears onEliezer S. YudkowskyHuman AI to superhuman (Re: Max More)1998-09-07 · publishedInspect the record ↗
- ContestsRobin HansonSingularity: Human AI to superhuman1998-09-10 · publishedInspect the record ↗
- Articulates · Earliest located use of the name “hard takeoff” · Relay of another authorVernor VingeSingularity: Vinge responds1998-09-16 · publishedInspect the record ↗
- ArticulatesEliezer YudkowskyCreating Friendly AI 1.0: The Analysis and Design of Benevolent Goal Architectures2001-06-15 · published · wording attested 2001-06-17Inspect the record ↗
- ArticulatesNick BostromEthical Issues in Advanced Artificial Intelligence2003 · published · wording attested 2003-08-06Inspect the record ↗
- ArticulatesEliezer YudkowskyArtificial Intelligence as a Positive and Negative Factor in Global Risk2006-02-05Inspect the record ↗
- ContestsRobin HansonWhat Core Argument?2008-12 · published · wording known only from a later, undated copyInspect the record ↗
- ArticulatesEliezer YudkowskyRecursive Self-Improvement2008-12-01 · publishedInspect the record ↗
- ArticulatesEliezer YudkowskyHard Takeoff2008-12-02 · publishedInspect the record ↗
- Bears onDavid J. ChalmersThe Singularity: A Philosophical Analysis2010 · publishedInspect the record ↗
- Bears onLuke Muehlhauser; Anna SalamonIntelligence Explosion: Evidence and Import2012 · publishedInspect the record ↗
- ArticulatesByline not recordedIntelligence Explosion Microeconomics2013-09-13 · publishedInspect the record ↗
- ContestsRobin HansonI Still Don't Get Foom2014-07-24 · publishedInspect the record ↗
- Bears onSam AltmanMachine intelligence, part 12015-02-25 · publishedInspect the record ↗
- ContestsToby WalshThe Singularity May Never Be Near2016-02-20 · publishedInspect the record ↗
- Bears onEliezer YudkowskyOptimization daemons2016-03-22 · published · wording known only from a later, undated copyInspect the record ↗
- ContestsSebastian BenthallDon't Fear the Reaper: Refuting Bostrom's Superintelligence Argument2017-02-27 · publishedInspect the record ↗
- ContestsKevin KellyThe Myth of a Superhuman AI2017-04-27 · publishedInspect the record ↗
- ContestsRodney BrooksThe Seven Deadly Sins of Predicting the Future of AI2017-09-07 · publishedInspect the record ↗
- ContestsAI ImpactsLikelihood of discontinuous progress around the development of AGI2018-02-23 · published · wording attested 2020-05-26Inspect the record ↗
- ContestsPaul ChristianoTakeoff speeds2018-02-24 · publishedInspect the record ↗
- Bears onPaul ChristianoWhat failure looks like2019-03-17 · publishedInspect the record ↗
- ContestsRobin HansonFoom Update2022-05-06 · publishedInspect the record ↗
- Bears onEliezer YudkowskyAGI Ruin: A List of Lethalities2022-06-05 · publishedInspect the record ↗
- Bears onPaul ChristianoWhere I agree and disagree with Eliezer2022-06-19 · publishedInspect the record ↗
- ArticulatesAjeya CotraWithout specific countermeasures, the easiest path to transformative AI likely leads to AI takeover2022-07-18 · publishedInspect the record ↗
- ContestsKatja GraceCounterarguments to the basic AI x-risk case2022-08-31 · publishedInspect the record ↗
- ContestsDavid ThorstadAgainst the singularity hypothesis2022-11 · publishedInspect the record ↗
- ArticulatesTom DavidsonWhat a compute-centric framework says about AI takeoff speeds2023-01-23 · published · wording attested 2025-04-01Inspect the record ↗
- Bears onLeopold AschenbrennerSituational Awareness: The Decade Ahead2024 · publishedInspect the record ↗
- ContestsArvind Narayanan; Sayash KapoorAI as Normal Technology2025-04-15 · publishedInspect the record ↗
- Bears onTom Davidson; Tom HouldenHow quick and big would a software intelligence explosion be?2025-08-04 · publishedInspect the record ↗
A5 AI-automated AI research
- Bears on · SatiricalCellarius (Samuel Butler)Darwin among the Machines1863-06-13 · publishedInspect the record ↗
- Bears onA. M. TuringComputing Machinery and Intelligence1950-10 · publishedInspect the record ↗
- Bears onNorbert WienerSome Moral and Technical Consequences of Automation1960-05-06 · published · claimed 1959-12-27Inspect the record ↗
- Bears onMarvin MinskySteps Toward Artificial Intelligence1961-01 · published · wording known only from a later, undated copy · claimed 1960-10-24Inspect the record ↗
- Articulates · Earliest locatedCrossrefSpeculations Concerning the First Ultraintelligent Machine1965 · published · claimed 1962-10Inspect the record ↗
- ArticulatesHans MoravecToday’s Computers, Intelligent Machines and Our Future1979-02 · published · wording attested 2001-07-10 · claimed 1976-07-21Inspect the record ↗
- ArticulatesRay J. SolomonoffThe Time Scale of Artificial Intelligence: Reflections on Social Effects1985 · published · wording attested 2006-07-16Inspect the record ↗
- ArticulatesK. Eric DrexlerEngines of Creation: The Coming Era of Nanotechnology1986 · published · wording attested 1997-07-09Inspect the record ↗
- ArticulatesHans MoravecHuman Culture—A Genetic Takeover Underway1989 · published · wording attested 2001-03-06 · claimed 1988-07Inspect the record ↗
- ArticulatesVernor VingeThe Coming Technological Singularity: How to Survive in the Post-Human Era1993-12 · published · claimed 1993-03-30Inspect the record ↗
- Bears onDani EderRe: The Singularity (Eder)1994-05-23 · published · wording attested 1997-07-12Inspect the record ↗
- Bears onK. Eric Drexler; Mark Miller; other contributorsFuture Forecasts: Eric Drexler’s comments1995 · publishedInspect the record ↗
- Articulates · Relay of another authorLyle Burkheadintelligence increase1996-08-10 · publishedInspect the record ↗
- ArticulatesNick BostromRe: Thinking about the future...1996-09-04 · publishedInspect the record ↗
- ArticulatesEliezer S. YudkowskyStaring into the Singularity1996-11-18 · published · wording attested 2000-12-04Inspect the record ↗
- ArticulatesEliezer YudkowskyHard Takeoff2008-12-02 · publishedInspect the record ↗
- ArticulatesPaul ChristianoTakeoff speeds2018-02-24 · publishedInspect the record ↗
- ArticulatesAjeya CotraWithout specific countermeasures, the easiest path to transformative AI likely leads to AI takeover2022-07-18 · publishedInspect the record ↗
A6 Strategic or race compression
- Bears on · FictionSamuel Butler (published anonymously)Erewhon, or Over the Range1872 · publishedInspect the record ↗
- Articulates · Earliest locatedVernor VingeThe Coming Technological Singularity: How to Survive in the Post-Human Era1993-12 · published · claimed 1993-03-30Inspect the record ↗
- ArticulatesRobin HansonIf Uploads Come First: The Crack of a Future Dawn1994 · publishedInspect the record ↗
- Bears onK. Eric Drexler; Mark Miller; other contributorsFuture Forecasts: Eric Drexler’s comments1995 · publishedInspect the record ↗
- ContestsRobin HansonRe: Thinking about the future...1996-09-03 · publishedInspect the record ↗
- ArticulatesNick BostromRe: Thinking about the future...1996-09-04 · publishedInspect the record ↗
- Articulatesden OtterThe AI revolution (Was: Re: >H ART: The Truman Show)1998-06-23 · publishedInspect the record ↗
- ContestsAnders SandbergRe: The AI revolution (Was: Re: >H ART: The Truman Show)1998-06-23 · publishedInspect the record ↗
- ArticulatesEliezer YudkowskyArtificial Intelligence as a Positive and Negative Factor in Global Risk2006-02-05Inspect the record ↗
- ArticulatesCarl ShulmanArms Control and Intelligence Explosions2009-07-02 · published · wording known only from a later, undated copyInspect the record ↗
- Articulates · Relay of another authorKatja GraceSuperintelligence 11: The treacherous turn2014-11-25 · publishedInspect the record ↗
- ContestsPaul ChristianoTakeoff speeds2018-02-24 · publishedInspect the record ↗
- ArticulatesAjeya CotraWithout specific countermeasures, the easiest path to transformative AI likely leads to AI takeover2022-07-18 · publishedInspect the record ↗
B · Changing epistemic adequacy
B1 Treacherous turn
- Bears onVernor VingeThe Coming Technological Singularity: How to Survive in the Post-Human Era1993-12 · published · claimed 1993-03-30Inspect the record ↗
- Bears onLee Daniel CrockerRe: Goal-based AI1996-12-31 · publishedInspect the record ↗
- Bears onEliezer YudkowskyRe: Goal-based AI1996-12-31 · publishedInspect the record ↗
- Bears onEliezer YudkowskyRe: Goal-based AI1996-12-31 · publishedInspect the record ↗
- Articulates · Earliest locatedEliezer YudkowskyCreating Friendly AI 1.0: The Analysis and Design of Benevolent Goal Architectures2001-06-15 · published · wording attested 2001-06-17Inspect the record ↗
- Bears on · Earliest located use of the name “treacherous turn”Katja GraceSuperintelligence reading group2014-08-31 · publishedInspect the record ↗
- Articulates · Relay of another authorKatja GraceSuperintelligence 11: The treacherous turn2014-11-25 · publishedInspect the record ↗
- ArticulatesNate Soares; Benja Fallenstein; Eliezer Yudkowsky; Stuart ArmstrongCorrigibility2015-01-25 · publishedInspect the record ↗
- ArticulatesEliezer YudkowskyContext disaster2015-06-08 · published · wording known only from a later, undated copyInspect the record ↗
- ContestsBen GoertzelSuperintelligence: Fears, Promises and Potentials2015-11 · publishedInspect the record ↗
- ArticulatesEvan Hubinger; Chris van Merwijk; Vladimir Mikulik; Joar Skalse; Scott GarrabrantDeceptive Alignment (Risks from Learned Optimization, part 4)2019-06-05 · publishedInspect the record ↗
- ArticulatesAjeya CotraWhy AI alignment could be hard with modern deep learning2021-09-21 · publishedInspect the record ↗
- ContestsPaul ChristianoWhere I agree and disagree with Eliezer2022-06-19 · publishedInspect the record ↗
- ArticulatesAjeya CotraWithout specific countermeasures, the easiest path to transformative AI likely leads to AI takeover2022-07-18 · publishedInspect the record ↗
- ArticulatesRichard NgoThe Alignment Problem from a Deep Learning Perspective2022-08-30 · publishedInspect the record ↗
- ArticulatesRohin Shah; Vikrant Varma; Ramana Kumar; Mary Phuong; Victoria Krakovna; Jonathan Uesato; Zac KentonGoal Misgeneralization: Why Correct Specifications Aren't Enough For Correct Goals2022-10-04 · publishedInspect the record ↗
- ArticulatesJoseph CarlsmithScheming AIs: Will AIs fake alignment during training in order to get power?2023-11-14 · publishedInspect the record ↗
- ContestsNora Belrose; Quintin PopeAI is easy to control2023-11-28 · publishedInspect the record ↗
- Bears onRyan Greenblatt; Carson Denison; Benjamin Wright; Fabien Roger; Monte MacDiarmid; Sam Marks; Johannes Treutlein; Tim Belonax; Jack Chen; David Duvenaud; Akbir Khan; Julian Michael; Sören Mindermann; Ethan Perez; Linda Petrini; Jonathan Uesato; Jared Kaplan; Buck Shlegeris; Samuel R. Bowman; Evan HubingerAlignment faking in large language models2024-12-18 · publishedInspect the record ↗
B2 Strategic concealment
- Bears on · FictionSamuel Butler (published anonymously)Erewhon, or Over the Range1872 · publishedInspect the record ↗
- ArticulatesK. Eric DrexlerEngines of Creation: The Coming Era of Nanotechnology1986 · published · wording attested 1997-07-09Inspect the record ↗
- Articulates · Earliest locatedVernor VingeThe Coming Technological Singularity: How to Survive in the Post-Human Era1993-12 · published · claimed 1993-03-30Inspect the record ↗
- ArticulatesNick BostromRe: Thinking about the future...1996-09-03 · publishedInspect the record ↗
- Bears onDan ClemmensenRe: SI ultimatum speculation1996-09-07 · publishedInspect the record ↗
- ContestsLee Daniel CrockerRe: Goal-based AI1996-12-31 · publishedInspect the record ↗
- ArticulatesEliezer YudkowskyRe: Goal-based AI1996-12-31 · publishedInspect the record ↗
- ArticulatesEliezer YudkowskyRe: Goal-based AI1996-12-31 · publishedInspect the record ↗
- ArticulatesEliezer S. YudkowskyFrontiers of Friendly AI2000-09-28 · publishedInspect the record ↗
- ArticulatesEliezer YudkowskyCreating Friendly AI 1.0: The Analysis and Design of Benevolent Goal Architectures2001-06-15 · published · wording attested 2001-06-17Inspect the record ↗
- Bears onEliezer S. YudkowskyThe "AI Box" experiment2002-03-08 · publishedInspect the record ↗
- Articulates · Relay of another authorKatja GraceSuperintelligence 11: The treacherous turn2014-11-25 · publishedInspect the record ↗
- ArticulatesNate Soares; Benja Fallenstein; Eliezer Yudkowsky; Stuart ArmstrongCorrigibility2015-01-25 · publishedInspect the record ↗
- ArticulatesEliezer YudkowskyProgrammer deception2015-07-16 · published · wording known only from a later, undated copyInspect the record ↗
- ArticulatesPaul ChristianoWhat failure looks like2019-03-17 · publishedInspect the record ↗
- ArticulatesEliezer YudkowskyAGI Ruin: A List of Lethalities2022-06-05 · publishedInspect the record ↗
- ContestsPaul ChristianoWhere I agree and disagree with Eliezer2022-06-19 · publishedInspect the record ↗
- ArticulatesAjeya CotraWithout specific countermeasures, the easiest path to transformative AI likely leads to AI takeover2022-07-18 · publishedInspect the record ↗
B3 Deceptive alignment
- Bears onA. M. TuringComputing Machinery and Intelligence1950-10 · publishedInspect the record ↗
- Bears onDonald MichieComputer—servant or master1968 · published · wording attested 1986Inspect the record ↗
- Bears onK. Eric DrexlerEngines of Creation: The Coming Era of Nanotechnology1986 · published · wording attested 1997-07-09Inspect the record ↗
- Bears onMark RosenfelderRe: Cheating on the Turing Test1991-11-20 · publishedInspect the record ↗
- Bears onVernor VingeThe Coming Technological Singularity: How to Survive in the Post-Human Era1993-12 · published · claimed 1993-03-30Inspect the record ↗
- Bears onEliezer S. YudkowskyFrontiers of Friendly AI2000-09-28 · publishedInspect the record ↗
- Bears onEliezer YudkowskyOptimization daemons2016-03-22 · published · wording known only from a later, undated copyInspect the record ↗
- Bears onPaul ChristianoOpen question: are minimal circuits daemon-free?2018-05-05 · publishedInspect the record ↗
- Articulates · Earliest locatedPaul ChristianoWhat failure looks like2019-03-17 · publishedInspect the record ↗
- Bears on · Earliest located use of the name “deceptive alignment”Evan Hubinger; Chris van Merwijk; Vladimir Mikulik; Joar Skalse; Scott GarrabrantRisks from Learned Optimization: Introduction2019-05-31 · publishedInspect the record ↗
- ArticulatesEvan Hubinger; Chris van Merwijk; Vladimir Mikulik; Joar Skalse; Scott GarrabrantDeceptive Alignment (Risks from Learned Optimization, part 4)2019-06-05 · publishedInspect the record ↗
- ArticulatesEliezer YudkowskyAGI Ruin: A List of Lethalities2022-06-05 · publishedInspect the record ↗
- ArticulatesEvan HubingerHow likely is deceptive alignment?2022-08-30 · publishedInspect the record ↗
B4 Scheming
- Bears onK. Eric DrexlerEngines of Creation: The Coming Era of Nanotechnology1986 · published · wording attested 1997-07-09Inspect the record ↗
- Articulates · Earliest located · Earliest located use of the name “schemer”Ajeya CotraWhy AI alignment could be hard with modern deep learning2021-09-21 · publishedInspect the record ↗
- ArticulatesEvan HubingerHow likely is deceptive alignment?2022-08-30 · publishedInspect the record ↗
B5 Observed behaviour under training or oversight as evidence
- Bears on · FictionSamuel Butler (published anonymously)Erewhon, or Over the Range1872 · publishedInspect the record ↗
- Bears onNorbert WienerSome Moral and Technical Consequences of Automation1960-05-06 · published · claimed 1959-12-27Inspect the record ↗
- Bears onK. Eric DrexlerEngines of Creation: The Coming Era of Nanotechnology1986 · published · wording attested 1997-07-09Inspect the record ↗
- Bears onVernor VingeThe Coming Technological Singularity: How to Survive in the Post-Human Era1993-12 · published · claimed 1993-03-30Inspect the record ↗
- Bears onNick BostromRe: Thinking about the future...1996-09-03 · publishedInspect the record ↗
- ContestsLee Daniel CrockerRe: Goal-based AI1996-12-31 · publishedInspect the record ↗
- Articulates · Earliest locatedEliezer YudkowskyRe: Goal-based AI1996-12-31 · publishedInspect the record ↗
- ArticulatesEliezer YudkowskyRe: Goal-based AI1996-12-31 · publishedInspect the record ↗
- ArticulatesBrian AtkinsAI testing and containment Re: [SL4] Programmed morality2000-07-07 · publishedInspect the record ↗
- ContestsBill HibbardReply to AIRisk2006 · published · wording attested 2008-12-05Inspect the record ↗
- ArticulatesEliezer YudkowskyArtificial Intelligence as a Positive and Negative Factor in Global Risk2006-02-05Inspect the record ↗
- Articulates · Relay of another authorKatja GraceSuperintelligence 11: The treacherous turn2014-11-25 · publishedInspect the record ↗
- ContestsRichard LoosemoreDebunking Fallacies in the Theory of AI Motivation2015-05-05 · publishedInspect the record ↗
- ArticulatesEliezer YudkowskyContext disaster2015-06-08 · published · wording known only from a later, undated copyInspect the record ↗
- ArticulatesEliezer YudkowskyProgrammer deception2015-07-16 · published · wording known only from a later, undated copyInspect the record ↗
- Bears onPaul ChristianoOpen question: are minimal circuits daemon-free?2018-05-05 · publishedInspect the record ↗
- Bears onPaul ChristianoWhat failure looks like2019-03-17 · publishedInspect the record ↗
- Bears onAjeya CotraWhy AI alignment could be hard with modern deep learning2021-09-21 · publishedInspect the record ↗
- ArticulatesEliezer YudkowskyAGI Ruin: A List of Lethalities2022-06-05 · publishedInspect the record ↗
- ContestsPaul ChristianoWhere I agree and disagree with Eliezer2022-06-19 · publishedInspect the record ↗
- Bears onAjeya CotraWithout specific countermeasures, the easiest path to transformative AI likely leads to AI takeover2022-07-18 · publishedInspect the record ↗
B6 Control or purpose specification
- Articulates · Earliest located · SatiricalCellarius (Samuel Butler)Darwin among the Machines1863-06-13 · publishedInspect the record ↗
- Contests · Framed as a dreamUnsigned (attributed to Samuel Butler)Lucubratio Ebria1865-07-29 · publishedInspect the record ↗
- Articulates · FictionSamuel Butler (published anonymously)Erewhon, or Over the Range1872 · publishedInspect the record ↗
- Contests · FictionSamuel Butler (published anonymously)Erewhon, or Over the Range1872 · publishedInspect the record ↗
- ArticulatesAlan M. TuringIntelligent Machinery, a Heretical Theory1951Inspect the record ↗
- Bears onAlan M. TuringCan Digital Computers Think?1951-05-15Inspect the record ↗
- ArticulatesNorbert WienerSome Moral and Technical Consequences of Automation1960-05-06 · published · claimed 1959-12-27Inspect the record ↗
- ContestsA. L. SamuelSome Moral and Technical Consequences of Automation: A Refutation1960-09-16 · published · wording known only from a later, undated copyInspect the record ↗
- ArticulatesCrossrefSpeculations Concerning the First Ultraintelligent Machine1965 · published · claimed 1962-10Inspect the record ↗
- ContestsDonald MichieComputer—servant or master1968 · published · wording attested 1986Inspect the record ↗
- Bears onVernor VingeFirst Word1983-01 · publishedInspect the record ↗
- ContestsK. Eric DrexlerEngines of Creation: The Coming Era of Nanotechnology1986 · published · wording attested 1997-07-09Inspect the record ↗
- ArticulatesVernor VingeThe Coming Technological Singularity: How to Survive in the Post-Human Era1993-12 · published · claimed 1993-03-30Inspect the record ↗
- Bears onRobin HansonIf Uploads Come First: The Crack of a Future Dawn1994 · publishedInspect the record ↗
C · Wider senses recorded separately
C1 Behavioural tests as evidence of what a system is
- Bears onA. M. TuringComputing Machinery and Intelligence1950-10 · publishedInspect the record ↗
- Articulates · Earliest locatedDonald MichieComputer—servant or master1968 · published · wording attested 1986Inspect the record ↗
- ArticulatesMark RosenfelderRe: Cheating on the Turing Test1991-11-20 · publishedInspect the record ↗
- ArticulatesDavid GudemanAwareness1991-11-27 · publishedInspect the record ↗
- ArticulatesMark RosenfelderReal-life Turing test1992-02-10 · publishedInspect the record ↗
- ContestsTorkel FranzenRe: Real-life Turing test (Franzen)1992-02-11 · publishedInspect the record ↗
- ContestsDaryl McCulloughRe: Real-life Turing Test (McCullough)1992-02-14 · publishedInspect the record ↗
- Bears onChristopher McKinstryUsefulness of the Turing Test1994-12-29 · publishedInspect the record ↗
C2 Systems designed to mislead their testers
- Articulates · Earliest locatedA. M. TuringComputing Machinery and Intelligence1950-10 · publishedInspect the record ↗
- ArticulatesK. Eric DrexlerEngines of Creation: The Coming Era of Nanotechnology1986 · published · wording attested 1997-07-09Inspect the record ↗
- ArticulatesMark RosenfelderRe: Cheating on the Turing Test1991-11-20 · publishedInspect the record ↗