{"entities":[{"id":"benevolence-or-no-drive-to-dominate","name":"Intelligence brings benevolence or no drive to dominate","type":"concept","proposition":{"code":"R10a","criterion":"Sufficiently intelligent AI systems will be benevolent, or will lack any drive to dominate or harm people, because greater intelligence brings good values or because such drives come from evolved motives that AI systems need not have.","terms":[]}},{"id":"bengio-2024-reasoning-through-arguments","name":"Reasoning through arguments against taking AI safety seriously","type":"document","subtype":"Blog post","description":"A blog post by Yoshua Bengio, Author's blog, dated 9 July 2024. Date in the post address and its datePublished metadata.","sourceIds":["source-rd-bengio-2024-reasoning-through-arguments"]},{"id":"capabilities-plateau","name":"Capabilities will plateau","type":"concept","proposition":{"code":"R13","criterion":"Current approaches to AI (deep learning, or the scaling of large language models) will reach limits short of general or superhuman intelligence.","terms":["hitting a wall","plateau","diminishing returns"]}},{"id":"incentives-produce-safety","name":"Economic incentives will produce safety","type":"concept","proposition":{"code":"R17","criterion":"Developers' commercial or economic incentives, such as the need to sell useful and reliable products and to avoid liability or reputational harm, will lead them to make AI systems safe without special measures against catastrophic risk.","terms":["incentives","market","liability"]}},{"id":"instrumental-convergence","name":"Instrumental convergence","type":"concept","proposition":{"code":"R02","criterion":"Agents with a wide range of final goals would tend to pursue the same intermediate goals, such as self-preservation, keeping their goals unchanged, acquiring resources or power, or improving themselves, because these serve almost any final goal.","terms":["instrumental convergence","convergent instrumental","basic AI drives","power-seeking"]}},{"id":"open-models-reduce-risk","name":"Open models reduce risk","type":"concept","proposition":{"code":"R15","criterion":"Openly releasing the weights of advanced AI models reduces overall risk, or adds little marginal risk compared with closed models and existing technologies, for example by enabling scrutiny, defensive use and a wide distribution of power.","terms":["open source","open weights","open models","marginal risk"]}},{"id":"risk-claims-speculative","name":"Risk claims are speculative or unfalsifiable","type":"concept","proposition":{"code":"R11","criterion":"Claims that advanced AI poses catastrophic or existential risk are speculative, unfalsifiable or not supported by evidence, so that they should not guide research priorities or policy.","terms":["speculative","unfalsifiable","science fiction"]}}],"claims":[{"id":"rd-r02-bengio-2024-reasoning-through-arguments","subject":"bengio-2024-reasoning-through-arguments","predicate":"articulates_proposition","object":{"kind":"entity","entityId":"instrumental-convergence"},"topic":"ideas","statement":"Bengio's post of 9 July 2024 states that, to achieve apparently innocuous main goals, it is useful for an AI also to achieve potentially dangerous subgoals such as self-preservation or more control and power over its environment.","time":{"kind":"event","date":"2024-07-09","basis":"publication","note":"Date of posting."},"derivation":"explicit","resolution":"supported","editorialState":"seed","evidenceIds":["evidence-rd-r02-bengio-2024-reasoning-through-arguments-1"],"attributes":{"thought":{"roles":["articulation"],"register":"nonfiction"}}},{"id":"rd-r10a-bengio-2024-reasoning-through-arguments","subject":"bengio-2024-reasoning-through-arguments","predicate":"contests_proposition","object":{"kind":"entity","entityId":"benevolence-or-no-drive-to-dominate"},"topic":"ideas","statement":"Bengio's post of 9 July 2024 answers the view that AGI and superintelligent AI will be kind to humans, arguing that AI safety research points the other way and that an AI with a self-preservation goal would resist being turned off and might control or remove humans to that end.","time":{"kind":"event","date":"2024-07-09","basis":"publication","note":"Date of posting."},"derivation":"explicit","resolution":"supported","editorialState":"seed","evidenceIds":["evidence-rd-r10a-bengio-2024-reasoning-through-arguments-1","evidence-rd-r10a-bengio-2024-reasoning-through-arguments-2"],"attributes":{"thought":{"roles":["contesting"],"register":"nonfiction","engagement":{"kind":"engages-premise","rationale":"Disputes that advanced AI would be benevolent, by arguing that self-preservation goals can arise instrumentally or be given by humans and would lead an AI to resist being turned off."}}}},{"id":"rd-r11-bengio-2024-reasoning-through-arguments","subject":"bengio-2024-reasoning-through-arguments","predicate":"contests_proposition","object":{"kind":"entity","entityId":"risk-claims-speculative"},"topic":"ideas","statement":"Bengio's blog post of 9 July 2024 argues that, given the stakes and the basic case for danger, very strong evidence should be required before concluding there is nothing to worry about, and that the arguments he has heard fall short of that bar.","time":{"kind":"event","date":"2024-07-09","basis":"publication","note":"Date of posting."},"derivation":"explicit","resolution":"supported","editorialState":"seed","evidenceIds":["evidence-rd-r11-bengio-2024-reasoning-through-arguments-1"],"attributes":{"thought":{"roles":["contesting"],"register":"nonfiction","engagement":{"kind":"engages-premise","rationale":"Disputes the premise that a lack of evidence for the risk justifies setting it aside."}}}},{"id":"rd-r13-bengio-2024-reasoning-arguments","subject":"bengio-2024-reasoning-through-arguments","predicate":"contests_proposition","object":{"kind":"entity","entityId":"capabilities-plateau"},"topic":"ideas","statement":"Bengio's post of July 2024 answers the argument that AGI is possible but only in many decades, holding that it cannot be ruled out that AGI is reached by adding some trick to current methods, that capability trend lines continue to point towards AGI, and that regulation takes years to put in place.","time":{"kind":"event","date":"2024-07-09","basis":"publication","note":"Date of posting."},"derivation":"explicit","resolution":"supported","editorialState":"seed","evidenceIds":["evidence-rd-r13-bengio-2024-reasoning-arguments-1"],"attributes":{"thought":{"roles":["contesting"],"register":"nonfiction","engagement":{"kind":"engages-premise","rationale":"It disputes the premise that current methods are known to fall short of AGI for decades."}}}},{"id":"rd-r15-bengio-2024-reasoning-arguments","subject":"bengio-2024-reasoning-through-arguments","predicate":"contests_proposition","object":{"kind":"entity","entityId":"open-models-reduce-risk"},"topic":"ideas","statement":"Bengio's post of 9 July 2024 states that open-sourcing may currently be more beneficial than detrimental to safety, but argues that as capabilities advance the decision should not rest with companies, and that the argument that good AIs would outnumber and defeat bad AIs has many flaws, including the advantage of attackers using bioweapons.","time":{"kind":"event","date":"2024-07-09","basis":"publication","note":"Date of posting."},"derivation":"explicit","resolution":"supported","editorialState":"seed","evidenceIds":["evidence-rd-r15-bengio-2024-reasoning-arguments-1","evidence-rd-r15-bengio-2024-reasoning-arguments-2"],"attributes":{"thought":{"roles":["contesting"],"register":"nonfiction","engagement":{"kind":"engages-premise","rationale":"Answers the defensive-balance premise (more good AIs than bad) with the offence-defence asymmetry."}}}},{"id":"rd-r17-bengio-2024-reasoning-arguments","subject":"bengio-2024-reasoning-through-arguments","predicate":"contests_proposition","object":{"kind":"entity","entityId":"incentives-produce-safety"},"topic":"ideas","statement":"Bengio's post of 9 July 2024 answers the argument that corporations would prefer to build safe AI by stating that the problem arises when safety and profit maximisation are not aligned, citing fossil-fuel and drug companies, and that global risks are an externality for developers.","time":{"kind":"event","date":"2024-07-09","basis":"publication","note":"Date of posting."},"derivation":"explicit","resolution":"supported","editorialState":"seed","evidenceIds":["evidence-rd-r17-bengio-2024-reasoning-arguments-1"],"attributes":{"thought":{"roles":["contesting"],"register":"nonfiction","engagement":{"kind":"engages-premise","rationale":"States the incentive argument as a question and answers it with the externality of global risks."}}}}],"sources":[{"id":"source-rd-bengio-2024-reasoning-through-arguments","documentId":"bengio-2024-reasoning-through-arguments","title":"Reasoning through arguments against taking AI safety seriously","authors":["Yoshua Bengio"],"publisher":"Author's blog (yoshuabengio.org)","publicationDate":"2024-07-09","version":"Retrieved for the candidate pack on 2026-10-29 (SHA-256 061559ecadb381ae005f6ca5ec2904200c35fa017592f40da91558ca372e60b2). Current page; its metadata gives datePublished 2024-07-09 and dateModified 2025-12-03, and the page shows no revision note, so later edits cannot be excluded. The cross-family check retrieved it again on 2026-10-31, with the same bytes. The cross-family check of 2026-10-31 found the sampled passages on evidence and on open-sourcing in the capture of 9 July 2024, at the post's earlier address; nearby wording differs, so the whole page is not identical.","evidenceUrl":"https://yoshuabengio.org/en/blog/reasoning-through-arguments-against-taking-ai-safety-seriously","language":"en","archivedUrl":"https://web.archive.org/web/20240709213152/https://yoshuabengio.org/2024/07/09/reasoning-through-arguments-against-taking-ai-safety-seriously/","archivedAt":"2024-07-09","accessedAt":"2026-10-29"}],"evidence":[{"id":"evidence-rd-r02-bengio-2024-reasoning-through-arguments-1","claimId":"rd-r02-bengio-2024-reasoning-through-arguments","sourceId":"source-rd-bengio-2024-reasoning-through-arguments","sourceRole":"primary","support":"supports","verification":"machine_checked","retrievalRoute":"direct"},{"id":"evidence-rd-r10a-bengio-2024-reasoning-through-arguments-1","claimId":"rd-r10a-bengio-2024-reasoning-through-arguments","sourceId":"source-rd-bengio-2024-reasoning-through-arguments","sourceRole":"primary","support":"supports","verification":"machine_checked","retrievalRoute":"direct"},{"id":"evidence-rd-r10a-bengio-2024-reasoning-through-arguments-2","claimId":"rd-r10a-bengio-2024-reasoning-through-arguments","sourceId":"source-rd-bengio-2024-reasoning-through-arguments","support":"supports","verification":"machine_checked","retrievalRoute":"direct"},{"id":"evidence-rd-r11-bengio-2024-reasoning-through-arguments-1","claimId":"rd-r11-bengio-2024-reasoning-through-arguments","sourceId":"source-rd-bengio-2024-reasoning-through-arguments","sourceRole":"primary","support":"supports","verification":"machine_checked","retrievalRoute":"direct"},{"id":"evidence-rd-r13-bengio-2024-reasoning-arguments-1","claimId":"rd-r13-bengio-2024-reasoning-arguments","sourceId":"source-rd-bengio-2024-reasoning-through-arguments","sourceRole":"primary","support":"supports","verification":"machine_checked","retrievalRoute":"direct"},{"id":"evidence-rd-r15-bengio-2024-reasoning-arguments-1","claimId":"rd-r15-bengio-2024-reasoning-arguments","sourceId":"source-rd-bengio-2024-reasoning-through-arguments","sourceRole":"primary","support":"supports","verification":"machine_checked","retrievalRoute":"direct"},{"id":"evidence-rd-r15-bengio-2024-reasoning-arguments-2","claimId":"rd-r15-bengio-2024-reasoning-arguments","sourceId":"source-rd-bengio-2024-reasoning-through-arguments","support":"context","verification":"machine_checked","retrievalRoute":"direct"},{"id":"evidence-rd-r17-bengio-2024-reasoning-arguments-1","claimId":"rd-r17-bengio-2024-reasoning-arguments","sourceId":"source-rd-bengio-2024-reasoning-through-arguments","sourceRole":"primary","support":"supports","verification":"machine_checked","retrievalRoute":"direct"}],"at":{"entities":[1790,1795,1808,1850,1852,1893,1902],"claims":[5145,5237,5253,5273,5308,5323],"sources":[1712],"evidence":[6825,6997,6998,7024,7055,7129,7130,7155]},"index":{"byClaim":[["rd-r02-bengio-2024-reasoning-through-arguments",["propositions:risk-debate"]],["rd-r10a-bengio-2024-reasoning-through-arguments",["propositions:risk-debate"]],["rd-r11-bengio-2024-reasoning-through-arguments",["propositions:risk-debate"]],["rd-r13-bengio-2024-reasoning-arguments",["propositions:risk-debate"]],["rd-r15-bengio-2024-reasoning-arguments",["propositions:risk-debate"]],["rd-r17-bengio-2024-reasoning-arguments",["propositions:risk-debate"]]],"marks":[],"chronicle":{"years":[{"year":1863,"topics":{"ideas":5},"stated":0},{"year":1865,"topics":{"ideas":1},"stated":0},{"year":1872,"topics":{"ideas":7},"stated":0},{"year":1943,"topics":{"ideas":1},"stated":0},{"year":1947,"topics":{"ideas":2},"stated":0},{"year":1950,"topics":{"ideas":7},"stated":0},{"year":1951,"topics":{"ideas":5},"stated":0},{"year":1952,"topics":{"ideas":2},"stated":0},{"year":1955,"topics":{"ideas":31},"stated":0},{"year":1956,"topics":{"ideas":1},"stated":0},{"year":1957,"topics":{"ideas":1},"stated":0},{"year":1958,"topics":{"ideas":3},"stated":0},{"year":1959,"topics":{"ideas":6},"stated":0},{"year":1960,"topics":{"ideas":11},"stated":0},{"year":1961,"topics":{"ideas":10},"stated":0},{"year":1965,"topics":{"ideas":8},"stated":0},{"year":1966,"topics":{"ideas":20},"stated":0},{"year":1968,"topics":{"ideas":5},"stated":0},{"year":1969,"topics":{"ideas":2},"stated":0},{"year":1971,"topics":{"ideas":4},"stated":0},{"year":1972,"topics":{"ideas":1},"stated":0},{"year":1973,"topics":{"ideas":2},"stated":0},{"year":1974,"topics":{"ideas":2},"stated":0},{"year":1975,"topics":{"ideas":1},"stated":0},{"year":1976,"topics":{"ideas":1},"stated":0},{"year":1977,"topics":{"people":2,"ideas":8},"stated":0},{"year":1979,"topics":{"ideas":4},"stated":0},{"year":1980,"topics":{"ideas":2},"stated":0},{"year":1981,"topics":{"people":2},"stated":0},{"year":1982,"topics":{"ideas":4},"stated":0},{"year":1983,"topics":{"ideas":4},"stated":0},{"year":1984,"topics":{"ideas":21},"stated":0},{"year":1985,"topics":{"ideas":9},"stated":0},{"year":1986,"topics":{"ideas":18},"stated":0},{"year":1987,"topics":{"ideas":1},"stated":0},{"year":1988,"topics":{"ideas":6},"stated":0},{"year":1989,"topics":{"ideas":8},"stated":0},{"year":1990,"topics":{"ideas":5},"stated":0},{"year":1991,"topics":{"ideas":11},"stated":0},{"year":1992,"topics":{"ideas":9},"stated":0},{"year":1993,"topics":{"ideas":14,"people":3},"stated":0},{"year":1994,"topics":{"ideas":14},"stated":0},{"year":1995,"topics":{"ideas":10,"people":1},"stated":0},{"year":1996,"topics":{"ideas":71},"stated":0},{"year":1997,"topics":{"ideas":12},"stated":0},{"year":1998,"topics":{"ideas":49},"stated":0},{"year":1999,"topics":{"ideas":27,"people":1,"institutions":1},"stated":0},{"year":2000,"topics":{"ideas":62},"stated":0},{"year":2001,"topics":{"ideas":39},"stated":0},{"year":2002,"topics":{"ideas":30},"stated":0},{"year":2003,"topics":{"ideas":8},"stated":0},{"year":2004,"topics":{"ideas":12,"people":3},"stated":0},{"year":2005,"topics":{"ideas":10,"people":1},"stated":0},{"year":2006,"topics":{"ideas":26,"people":1},"stated":0},{"year":2007,"topics":{"ideas":20},"stated":0},{"year":2008,"topics":{"ideas":57,"people":3,"institutions":1},"stated":0},{"year":2009,"topics":{"ideas":10,"people":1},"stated":0},{"year":2010,"topics":{"people":3,"ideas":11,"institutions":1,"governance":4},"stated":0},{"year":2011,"topics":{"people":3,"ideas":7,"institutions":2},"stated":0},{"year":2012,"topics":{"people":4,"ideas":17,"institutions":2},"stated":0},{"year":2013,"topics":{"ideas":46,"people":4,"institutions":2,"capital":1},"stated":0},{"year":2014,"topics":{"institutions":2,"ideas":54,"people":5},"stated":0},{"year":2015,"topics":{"people":22,"ideas":122,"institutions":3,"capital":1},"stated":0},{"year":2016,"topics":{"ideas":88,"people":2},"stated":0},{"year":2017,"topics":{"people":16,"institutions":2,"ideas":128,"governance":2},"stated":0},{"year":2018,"topics":{"people":8,"ideas":158,"institutions":8,"governance":1},"stated":0},{"year":2019,"topics":{"capital":1,"compute":1,"people":10,"governance":19,"ideas":175,"institutions":4},"stated":0},{"year":2020,"topics":{"people":6,"ideas":98,"institutions":1,"governance":2},"stated":0},{"year":2021,"topics":{"people":27,"ideas":177,"compute":1,"institutions":23,"governance":4,"capital":6},"stated":0},{"year":2022,"topics":{"people":15,"ideas":217,"institutions":6,"governance":3,"compute":2,"capital":1},"stated":0},{"year":2023,"topics":{"capital":5,"compute":7,"institutions":23,"people":51,"governance":179,"ideas":389},"stated":0},{"year":2024,"topics":{"capital":12,"compute":19,"governance":282,"people":80,"ideas":178,"institutions":28},"stated":1},{"year":2025,"topics":{"governance":547,"compute":69,"capital":34,"people":90,"institutions":18,"ideas":178},"stated":7},{"year":2026,"topics":{"governance":442,"capital":8,"compute":32,"institutions":21,"ideas":91,"people":107},"stated":19},{"year":2027,"topics":{},"stated":9},{"year":2028,"topics":{},"stated":6},{"year":2029,"topics":{},"stated":3},{"year":2030,"topics":{},"stated":3},{"year":2032,"topics":{},"stated":2},{"year":2035,"topics":{},"stated":2},{"year":2039,"topics":{},"stated":1},{"year":2042,"topics":{},"stated":1},{"year":2050,"topics":{},"stated":1}],"scheduled":[],"statedBy":[]},"collections":[{"target":{"kind":"propositions","id":"superintelligence"},"title":"Propositions about superintelligence, 1863–2022","claimIds":[],"records":[]},{"target":{"kind":"propositions","id":"risk-debate"},"title":"Arguments about catastrophic risk from advanced AI","claimIds":["rd-r02-bengio-2024-reasoning-through-arguments","rd-r10a-bengio-2024-reasoning-through-arguments","rd-r11-bengio-2024-reasoning-through-arguments","rd-r13-bengio-2024-reasoning-arguments","rd-r15-bengio-2024-reasoning-arguments","rd-r17-bengio-2024-reasoning-arguments"],"records":[]},{"target":{"kind":"propositions","id":"yudkowsky-arguments"},"title":"Eliezer Yudkowsky’s arguments on common claims about AI, 1996–2026","claimIds":[],"records":[]},{"target":{"kind":"propositions","id":"economics-of-machine-intelligence"},"title":"Economics of machine intelligence","claimIds":[],"records":[]},{"target":{"kind":"propositions","id":"orbital-compute-arguments"},"title":"Arguments about compute in orbit","claimIds":[],"records":[]},{"target":{"kind":"propositions","id":"ai-bio-arguments"},"title":"Arguments about AI and biological risk","claimIds":[],"records":[]},{"target":{"kind":"propositions","id":"ai-in-science"},"title":"AI in science","claimIds":[],"records":[]},{"target":{"kind":"documents"},"title":"Frontier safety frameworks","claimIds":[]},{"target":{"kind":"compare","id":"frontier-safety-frameworks"},"title":"Compare frameworks","claimIds":[]},{"target":{"kind":"control","id":"openai"},"title":"OpenAI’s control structure, 2015–2026","claimIds":[]},{"target":{"kind":"control","id":"anthropic"},"title":"Anthropic’s control structure, 2021–2026","claimIds":[]},{"target":{"kind":"commitments"},"title":"External commitments and obligations","claimIds":[]},{"target":{"kind":"question","id":"frameworks-to-obligations"},"title":"Frameworks, commitments and legal obligations, 2023–2026","claimIds":[]},{"target":{"kind":"reading"},"title":"Founding and early leadership","claimIds":[]}]},"version":"131evrz"}