Claim and evidence Close ×
The consensus paper by Bengio, Hinton, Yao and others of 26 October 2023 states that, without sufficient caution, humanity may irreversibly lose control of autonomous AI systems, which could culminate in large-scale loss of life and the marginalisation or extinction of humanity. Copy claim link
Copy claim reference
Machine-checked, not reviewed by an editor Stated in source Supported
Supporting evidence: primary · 1 source
Date 2023-10-26 · publication Records dated 2023 → Role Articulation Register (kind of text) Nonfiction Scope and limits The paper names malicious actors and accidental misalignment as two sources of undesirable goals; it records what the co-authored text says, not each co-author's views.
The evidence 03 primary source Supports the claim
Managing AI Risks in an Era of Rapid Progress ↗ arXiv:2310.17688 · 2023-10-26
Copy source reference
Cite the original source Cite the original document, not Selekoa. Check these details against it.
Copy APA
Download BibTeX Download RIS Download CSL-JSON
Source excerpt “Once autonomous AI systems pursue undesirable goals, embedded by malicious actors or by accident, we may be unable to keep them in check.” Location in source Section "Societal-scale risks", PDF p. 2
How it was read Retrieved directly from the publisher
Machine-checked · 2026-10-31
Source details and check notes Authors Yoshua Bengio; Geoffrey Hinton; Andrew Yao; Dawn Song; Pieter Abbeel; Yuval Noah Harari; Ya-Qin Zhang; Lan Xue; Shai Shalev-Shwartz; Gillian Hadfield; Jeff Clune; Tegan Maharaj; Frank Hutter; Atılım Güneş Baydin; Sheila McIlraith; Qiqi Gao; Ashwin Acharya; David Krueger; Anca Dragan; Philip Torr; Stuart Russell; Daniel Kahneman; Jan Brauner; Sören Mindermann Version Retrieved for the candidate pack on 2026-10-29 (SHA-256 d6ec9c8bb5db28ea6c52aff5cfb79a7c510244a9cb71dea01f3927f8b02afcc7). arXiv v1 PDF (2310.17688v1, 26 Oct 2023), titled "Managing AI Risks in an Era of Rapid Progress"; a revised version was published in Science in May 2024 as "Managing extreme AI risks amid rapid progress" and was not compared. The cross-family check retrieved it again on 2026-10-31, with the same bytes. Canonical address Open the canonical source ↗ Accessed 2026-10-29 Language English (en) Attribution Yoshua Bengio, Geoffrey Hinton, Andrew Yao, Dawn Song, Pieter Abbeel, Yuval Noah Harari, Ya-Qin Zhang, Lan Xue, Shai Shalev-Shwartz, Gillian Hadfield, Jeff Clune, Tegan Maharaj, Frank Hutter, Atılım Güneş Baydin, Sheila McIlraith, Qiqi Gao, Ashwin Acharya, David Krueger, Anca Dragan, Philip Torr, Stuart Russell, Daniel Kahneman, Jan Brauner, Sören Mindermann, “Managing AI Risks in an Era of Rapid Progress”, 2023-10-26. Reuse No open redistribution licence asserted. Bibliographic metadata, editorial paraphrases and short attributed quotations (at most 50 words each). Recheck terms before wider redistribution. Check notes Candidate pack passage, arguments about catastrophic risk from advanced AI (research/risk-debate). The quotation (23 words) matched the text retrieved for the candidate pack on 2026-10-29. Matching ignored differences of whitespace, case, quotation marks, dashes and Unicode compatibility forms, so the source’s typography can differ. No human editorial review. primary source Supports the claim
Managing AI Risks in an Era of Rapid Progress ↗ arXiv:2310.17688 · 2023-10-26
Copy source reference
Cite the original source Cite the original document, not Selekoa. Check these details against it.
Copy APA
Download BibTeX Download RIS Download CSL-JSON
Source excerpt “Without sufficient caution, we may irreversibly lose control of autonomous AI systems, rendering human intervention ineffective.” Location in source PDF p. 3
How it was read Retrieved directly from the publisher
Machine-checked · 2026-10-31
Source details and check notes Authors Yoshua Bengio; Geoffrey Hinton; Andrew Yao; Dawn Song; Pieter Abbeel; Yuval Noah Harari; Ya-Qin Zhang; Lan Xue; Shai Shalev-Shwartz; Gillian Hadfield; Jeff Clune; Tegan Maharaj; Frank Hutter; Atılım Güneş Baydin; Sheila McIlraith; Qiqi Gao; Ashwin Acharya; David Krueger; Anca Dragan; Philip Torr; Stuart Russell; Daniel Kahneman; Jan Brauner; Sören Mindermann Version Retrieved for the candidate pack on 2026-10-29 (SHA-256 d6ec9c8bb5db28ea6c52aff5cfb79a7c510244a9cb71dea01f3927f8b02afcc7). arXiv v1 PDF (2310.17688v1, 26 Oct 2023), titled "Managing AI Risks in an Era of Rapid Progress"; a revised version was published in Science in May 2024 as "Managing extreme AI risks amid rapid progress" and was not compared. The cross-family check retrieved it again on 2026-10-31, with the same bytes. Canonical address Open the canonical source ↗ Accessed 2026-10-29 Language English (en) Attribution Yoshua Bengio, Geoffrey Hinton, Andrew Yao, Dawn Song, Pieter Abbeel, Yuval Noah Harari, Ya-Qin Zhang, Lan Xue, Shai Shalev-Shwartz, Gillian Hadfield, Jeff Clune, Tegan Maharaj, Frank Hutter, Atılım Güneş Baydin, Sheila McIlraith, Qiqi Gao, Ashwin Acharya, David Krueger, Anca Dragan, Philip Torr, Stuart Russell, Daniel Kahneman, Jan Brauner, Sören Mindermann, “Managing AI Risks in an Era of Rapid Progress”, 2023-10-26. Reuse No open redistribution licence asserted. Bibliographic metadata, editorial paraphrases and short attributed quotations (at most 50 words each). Recheck terms before wider redistribution. Check notes Candidate pack passage, arguments about catastrophic risk from advanced AI (research/risk-debate). The quotation (16 words) matched the text retrieved for the candidate pack on 2026-10-29. Matching ignored differences of whitespace, case, quotation marks, dashes and Unicode compatibility forms, so the source’s typography can differ. No human editorial review. primary source Supports the claim
Managing AI Risks in an Era of Rapid Progress ↗ arXiv:2310.17688 · 2023-10-26
Copy source reference
Cite the original source Cite the original document, not Selekoa. Check these details against it.
Copy APA
Download BibTeX Download RIS Download CSL-JSON
Source excerpt “This unchecked AI advancement could culminate in a large-scale loss of life and the biosphere, and the marginalization or even extinction of humanity.” Location in source PDF p. 3
How it was read Retrieved directly from the publisher
Machine-checked · 2026-10-31
Source details and check notes Authors Yoshua Bengio; Geoffrey Hinton; Andrew Yao; Dawn Song; Pieter Abbeel; Yuval Noah Harari; Ya-Qin Zhang; Lan Xue; Shai Shalev-Shwartz; Gillian Hadfield; Jeff Clune; Tegan Maharaj; Frank Hutter; Atılım Güneş Baydin; Sheila McIlraith; Qiqi Gao; Ashwin Acharya; David Krueger; Anca Dragan; Philip Torr; Stuart Russell; Daniel Kahneman; Jan Brauner; Sören Mindermann Version Retrieved for the candidate pack on 2026-10-29 (SHA-256 d6ec9c8bb5db28ea6c52aff5cfb79a7c510244a9cb71dea01f3927f8b02afcc7). arXiv v1 PDF (2310.17688v1, 26 Oct 2023), titled "Managing AI Risks in an Era of Rapid Progress"; a revised version was published in Science in May 2024 as "Managing extreme AI risks amid rapid progress" and was not compared. The cross-family check retrieved it again on 2026-10-31, with the same bytes. Canonical address Open the canonical source ↗ Accessed 2026-10-29 Language English (en) Attribution Yoshua Bengio, Geoffrey Hinton, Andrew Yao, Dawn Song, Pieter Abbeel, Yuval Noah Harari, Ya-Qin Zhang, Lan Xue, Shai Shalev-Shwartz, Gillian Hadfield, Jeff Clune, Tegan Maharaj, Frank Hutter, Atılım Güneş Baydin, Sheila McIlraith, Qiqi Gao, Ashwin Acharya, David Krueger, Anca Dragan, Philip Torr, Stuart Russell, Daniel Kahneman, Jan Brauner, Sören Mindermann, “Managing AI Risks in an Era of Rapid Progress”, 2023-10-26. Reuse No open redistribution licence asserted. Bibliographic metadata, editorial paraphrases and short attributed quotations (at most 50 words each). Recheck terms before wider redistribution. Check notes Candidate pack passage, arguments about catastrophic risk from advanced AI (research/risk-debate). The quotation (23 words) matched the text retrieved for the candidate pack on 2026-10-29. Matching ignored differences of whitespace, case, quotation marks, dashes and Unicode compatibility forms, so the source’s typography can differ. No human editorial review. Status and meaning Editorial status. Not reviewed by an editor . An exploratory record that no editor has accepted. This status does not say whether a person has read any linked passage. Each evidence record above shows how it was checked.
Relation. A passage of the document meets the proposition’s criterion. The record documents what the text states, in its register (fiction and satire are labelled); it is not evidence that the proposition is true and implies no influence on or from another text.
Date. Date of the arXiv v1 submission.
Record ID rd-r08-bengio-2023-managing-ai-risks