{"entities":[{"id":"bengio-2023-rogue-ais","name":"How Rogue AIs may Arise","type":"document","subtype":"Blog post","description":"A blog post by Yoshua Bengio, Author's blog, dated 22 May 2023. Date in the post address and its datePublished metadata.","sourceIds":["source-rd-bengio-2023-rogue-ais"]},{"id":"loss-of-control-route","name":"Existential risk from misalignment or loss of control","type":"concept","proposition":{"code":"R08","criterion":"Advanced AI systems pursuing goals at odds with human interests could escape human control and cause human extinction or permanent human disempowerment, without any person intending that outcome.","terms":["loss of control","rogue AI","misaligned AI","disempowerment"]}},{"id":"misuse-route","name":"Catastrophic risk from misuse","type":"concept","proposition":{"code":"R09","criterion":"People's deliberate use of advanced AI, for example to develop weapons of mass destruction, to attack critical systems, or to seize or entrench power, could cause catastrophe at the scale of mass casualties or worse.","terms":["misuse","malicious use","bad actors"]}}],"claims":[{"id":"rd-r08-bengio-2023-rogue-ais","subject":"bengio-2023-rogue-ais","predicate":"articulates_proposition","object":{"kind":"entity","entityId":"loss-of-control-route"},"topic":"ideas","statement":"Bengio's blog post of 22 May 2023 defines a potentially rogue AI as an autonomous system that could be catastrophically harmful to a large fraction of humans, and argues that an autonomous, goal-directed superintelligent system whose goals do not strictly include human well-being would be one.","time":{"kind":"event","date":"2023-05-22","basis":"publication","note":"Date of posting."},"derivation":"explicit","resolution":"supported","editorialState":"seed","evidenceIds":["evidence-rd-r08-bengio-2023-rogue-ais-1","evidence-rd-r08-bengio-2023-rogue-ais-2"],"attributes":{"thought":{"roles":["articulation"],"register":"nonfiction","attested":{"date":"2023-05-23","note":"The page metadata records a modification on 2025-12-03. The cross-family check of 2026-10-31 found both quoted passages in an archive capture of 23 May 2023; it did not compare the whole page."}}}},{"id":"rd-r09-bengio-2023-rogue-ais","subject":"bengio-2023-rogue-ais","predicate":"articulates_proposition","object":{"kind":"entity","entityId":"misuse-route"},"topic":"ideas","statement":"Bengio's blog post of 22 May 2023 states that once a recipe for a rogue AI is accessible, one or a few people intending to destroy humanity could build one, and calls this the fastest route to a rogue AI.","time":{"kind":"event","date":"2023-05-22","basis":"publication","note":"Date of posting."},"derivation":"explicit","resolution":"supported","editorialState":"seed","evidenceIds":["evidence-rd-r09-bengio-2023-rogue-ais-1","evidence-rd-r09-bengio-2023-rogue-ais-2"],"attributes":{"thought":{"roles":["articulation"],"register":"nonfiction","attested":{"date":"2026-10-29","note":"The page metadata records a modification on 2025-12-03; the quoted wording is attested from the retrieval of 2026-10-29 and was not compared with a copy of its year of publication."}}}}],"sources":[{"id":"source-rd-bengio-2023-rogue-ais","documentId":"bengio-2023-rogue-ais","title":"How Rogue AIs may Arise","authors":["Yoshua Bengio"],"publisher":"Author's blog (yoshuabengio.org)","publicationDate":"2023-05-22","version":"Retrieved for the candidate pack on 2026-10-29 (SHA-256 d6b3b336a8264a853fb6d8e480f9445a5f48ea92e4072f39e84ca517571fff6a). Current page; its metadata gives datePublished 2023-05-22 and dateModified 2025-12-03, and the page shows no revision note, so later edits cannot be excluded. The cross-family check retrieved it again on 2026-10-31, with the same bytes. The cross-family check of 2026-10-31 found Definition 1 and Claim 2 in the capture of 23 May 2023, at the post's earlier address; it did not compare the whole page.","evidenceUrl":"https://yoshuabengio.org/en/blog/how-rogue-ais-may-arise","language":"en","archivedUrl":"https://web.archive.org/web/20230523031438/https://yoshuabengio.org/2023/05/22/how-rogue-ais-may-arise/","archivedAt":"2023-05-23","accessedAt":"2026-10-29"}],"evidence":[{"id":"evidence-rd-r08-bengio-2023-rogue-ais-1","claimId":"rd-r08-bengio-2023-rogue-ais","sourceId":"source-rd-bengio-2023-rogue-ais","sourceRole":"primary","support":"supports","verification":"machine_checked","retrievalRoute":"direct"},{"id":"evidence-rd-r08-bengio-2023-rogue-ais-2","claimId":"rd-r08-bengio-2023-rogue-ais","sourceId":"source-rd-bengio-2023-rogue-ais","support":"supports","verification":"machine_checked","retrievalRoute":"direct"},{"id":"evidence-rd-r09-bengio-2023-rogue-ais-1","claimId":"rd-r09-bengio-2023-rogue-ais","sourceId":"source-rd-bengio-2023-rogue-ais","sourceRole":"primary","support":"supports","verification":"machine_checked","retrievalRoute":"direct"},{"id":"evidence-rd-r09-bengio-2023-rogue-ais-2","claimId":"rd-r09-bengio-2023-rogue-ais","sourceId":"source-rd-bengio-2023-rogue-ais","support":"supports","verification":"machine_checked","retrievalRoute":"direct"}],"at":{"entities":[1794,1865,1878],"claims":[5218,5227],"sources":[1711],"evidence":[6963,6964,6980,6981]},"index":{"byClaim":[["rd-r08-bengio-2023-rogue-ais",["propositions:risk-debate"]],["rd-r09-bengio-2023-rogue-ais",["propositions:risk-debate"]]],"marks":[],"chronicle":{"years":[{"year":1863,"topics":{"ideas":5},"stated":0},{"year":1865,"topics":{"ideas":1},"stated":0},{"year":1872,"topics":{"ideas":7},"stated":0},{"year":1943,"topics":{"ideas":1},"stated":0},{"year":1947,"topics":{"ideas":2},"stated":0},{"year":1950,"topics":{"ideas":7},"stated":0},{"year":1951,"topics":{"ideas":5},"stated":0},{"year":1952,"topics":{"ideas":2},"stated":0},{"year":1955,"topics":{"ideas":31},"stated":0},{"year":1956,"topics":{"ideas":1},"stated":0},{"year":1957,"topics":{"ideas":1},"stated":0},{"year":1958,"topics":{"ideas":3},"stated":0},{"year":1959,"topics":{"ideas":6},"stated":0},{"year":1960,"topics":{"ideas":11},"stated":0},{"year":1961,"topics":{"ideas":10},"stated":0},{"year":1965,"topics":{"ideas":8},"stated":0},{"year":1966,"topics":{"ideas":20},"stated":0},{"year":1968,"topics":{"ideas":5},"stated":0},{"year":1969,"topics":{"ideas":2},"stated":0},{"year":1971,"topics":{"ideas":4},"stated":0},{"year":1972,"topics":{"ideas":1},"stated":0},{"year":1973,"topics":{"ideas":2},"stated":0},{"year":1974,"topics":{"ideas":2},"stated":0},{"year":1975,"topics":{"ideas":1},"stated":0},{"year":1976,"topics":{"ideas":1},"stated":0},{"year":1977,"topics":{"people":2,"ideas":8},"stated":0},{"year":1979,"topics":{"ideas":4},"stated":0},{"year":1980,"topics":{"ideas":2},"stated":0},{"year":1981,"topics":{"people":2},"stated":0},{"year":1982,"topics":{"ideas":4},"stated":0},{"year":1983,"topics":{"ideas":4},"stated":0},{"year":1984,"topics":{"ideas":21},"stated":0},{"year":1985,"topics":{"ideas":9},"stated":0},{"year":1986,"topics":{"ideas":18},"stated":0},{"year":1987,"topics":{"ideas":1},"stated":0},{"year":1988,"topics":{"ideas":6},"stated":0},{"year":1989,"topics":{"ideas":8},"stated":0},{"year":1990,"topics":{"ideas":5},"stated":0},{"year":1991,"topics":{"ideas":11},"stated":0},{"year":1992,"topics":{"ideas":9},"stated":0},{"year":1993,"topics":{"ideas":14,"people":3},"stated":0},{"year":1994,"topics":{"ideas":14},"stated":0},{"year":1995,"topics":{"ideas":10,"people":1},"stated":0},{"year":1996,"topics":{"ideas":71},"stated":0},{"year":1997,"topics":{"ideas":12},"stated":0},{"year":1998,"topics":{"ideas":49},"stated":0},{"year":1999,"topics":{"ideas":27,"people":1,"institutions":1},"stated":0},{"year":2000,"topics":{"ideas":62},"stated":0},{"year":2001,"topics":{"ideas":39},"stated":0},{"year":2002,"topics":{"ideas":30},"stated":0},{"year":2003,"topics":{"ideas":8},"stated":0},{"year":2004,"topics":{"ideas":12,"people":3},"stated":0},{"year":2005,"topics":{"ideas":10,"people":1},"stated":0},{"year":2006,"topics":{"ideas":26,"people":1},"stated":0},{"year":2007,"topics":{"ideas":20},"stated":0},{"year":2008,"topics":{"ideas":57,"people":3,"institutions":1},"stated":0},{"year":2009,"topics":{"ideas":10,"people":1},"stated":0},{"year":2010,"topics":{"people":3,"ideas":11,"institutions":1,"governance":4},"stated":0},{"year":2011,"topics":{"people":3,"ideas":7,"institutions":2},"stated":0},{"year":2012,"topics":{"people":4,"ideas":17,"institutions":2},"stated":0},{"year":2013,"topics":{"ideas":46,"people":4,"institutions":2,"capital":1},"stated":0},{"year":2014,"topics":{"institutions":2,"ideas":54,"people":5},"stated":0},{"year":2015,"topics":{"people":22,"ideas":122,"institutions":3,"capital":1},"stated":0},{"year":2016,"topics":{"ideas":88,"people":2},"stated":0},{"year":2017,"topics":{"people":16,"institutions":2,"ideas":128,"governance":2},"stated":0},{"year":2018,"topics":{"people":8,"ideas":158,"institutions":8,"governance":1},"stated":0},{"year":2019,"topics":{"capital":1,"compute":1,"people":10,"governance":19,"ideas":175,"institutions":4},"stated":0},{"year":2020,"topics":{"people":6,"ideas":98,"institutions":1,"governance":2},"stated":0},{"year":2021,"topics":{"people":27,"ideas":177,"compute":1,"institutions":23,"governance":4,"capital":6},"stated":0},{"year":2022,"topics":{"people":15,"ideas":217,"institutions":6,"governance":3,"compute":2,"capital":1},"stated":0},{"year":2023,"topics":{"capital":5,"compute":7,"institutions":23,"people":51,"governance":179,"ideas":389},"stated":0},{"year":2024,"topics":{"capital":12,"compute":19,"governance":282,"people":80,"ideas":178,"institutions":28},"stated":1},{"year":2025,"topics":{"governance":547,"compute":69,"capital":34,"people":90,"institutions":18,"ideas":178},"stated":7},{"year":2026,"topics":{"governance":442,"capital":8,"compute":32,"institutions":21,"ideas":91,"people":107},"stated":19},{"year":2027,"topics":{},"stated":9},{"year":2028,"topics":{},"stated":6},{"year":2029,"topics":{},"stated":3},{"year":2030,"topics":{},"stated":3},{"year":2032,"topics":{},"stated":2},{"year":2035,"topics":{},"stated":2},{"year":2039,"topics":{},"stated":1},{"year":2042,"topics":{},"stated":1},{"year":2050,"topics":{},"stated":1}],"scheduled":[],"statedBy":[]},"collections":[{"target":{"kind":"propositions","id":"superintelligence"},"title":"Propositions about superintelligence, 1863–2022","claimIds":[],"records":[]},{"target":{"kind":"propositions","id":"risk-debate"},"title":"Arguments about catastrophic risk from advanced AI","claimIds":["rd-r08-bengio-2023-rogue-ais","rd-r09-bengio-2023-rogue-ais"],"records":[]},{"target":{"kind":"propositions","id":"yudkowsky-arguments"},"title":"Eliezer Yudkowsky’s arguments on common claims about AI, 1996–2026","claimIds":[],"records":[]},{"target":{"kind":"propositions","id":"economics-of-machine-intelligence"},"title":"Economics of machine intelligence","claimIds":[],"records":[]},{"target":{"kind":"propositions","id":"orbital-compute-arguments"},"title":"Arguments about compute in orbit","claimIds":[],"records":[]},{"target":{"kind":"propositions","id":"ai-bio-arguments"},"title":"Arguments about AI and biological risk","claimIds":[],"records":[]},{"target":{"kind":"propositions","id":"ai-in-science"},"title":"AI in science","claimIds":[],"records":[]},{"target":{"kind":"documents"},"title":"Frontier safety frameworks","claimIds":[]},{"target":{"kind":"compare","id":"frontier-safety-frameworks"},"title":"Compare frameworks","claimIds":[]},{"target":{"kind":"control","id":"openai"},"title":"OpenAI’s control structure, 2015–2026","claimIds":[]},{"target":{"kind":"control","id":"anthropic"},"title":"Anthropic’s control structure, 2021–2026","claimIds":[]},{"target":{"kind":"commitments"},"title":"External commitments and obligations","claimIds":[]},{"target":{"kind":"question","id":"frameworks-to-obligations"},"title":"Frameworks, commitments and legal obligations, 2023–2026","claimIds":[]},{"target":{"kind":"reading"},"title":"Founding and early leadership","claimIds":[]}]},"version":"131evrz"}