{"entities":[{"id":"kapoor-open-foundation-models-2024-02","name":"On the Societal Impact of Open Foundation Models","type":"document","documentVersion":{"family":"kapoor-open-foundation-models","label":"arXiv v1 (27 February 2024)","publisherId":"arxiv","publishedAt":"2024-02-27","dateNote":"The PDF's arXiv stamp reads \"arXiv:2403.07918v1 [cs.CY] 27 Feb 2024\" and the paper's own dateline reads \"February 27, 2024\" (`kapoor-open-2024`)."}},{"id":"gopal-2023-pandemic-agents","name":"Will releasing the weights of large language models grant widespread access to pandemic agents?","type":"document","subtype":"Preprint","description":"A preprint by Anjali Gopal and 8 co-authors, arXiv:2310.18233, dated 25 October 2023. arXiv submission history: v1 Wed, 25 Oct 2023; v2 1 Nov 2023.","sourceIds":["source-rd-gopal-2023-pandemic-agents"]},{"id":"open-models-reduce-risk","name":"Open models reduce risk","type":"concept","proposition":{"code":"R15","criterion":"Openly releasing the weights of advanced AI models reduces overall risk, or adds little marginal risk compared with closed models and existing technologies, for example by enabling scrutiny, defensive use and a wide distribution of power.","terms":["open source","open weights","open models","marginal risk"]}}],"claims":[{"id":"rd-r15-gopal-2023-pandemic-agents","subject":"gopal-2023-pandemic-agents","predicate":"contests_proposition","object":{"kind":"entity","entityId":"open-models-reduce-risk"},"topic":"ideas","statement":"Gopal and co-authors' paper of 25 October 2023 states that its results suggest that releasing the weights of advanced foundation models, no matter how robustly safeguarded, will trigger the proliferation of knowledge sufficient to acquire pandemic agents and other biological weapons.","time":{"kind":"event","date":"2023-10-25","basis":"publication","note":"Date of the arXiv v1 submission."},"derivation":"explicit","resolution":"supported","editorialState":"seed","evidenceIds":["evidence-rd-r15-gopal-2023-pandemic-agents-1"],"attributes":{"thought":{"roles":["contesting"],"register":"nonfiction","engagement":{"kind":"engages-premise","rationale":"Answers the premise that safeguards keep the misuse risk of released weights low, stating that release proliferates such knowledge however robustly the model is safeguarded."}}}},{"id":"rd-reply-kapoor-2024-open-foundation-models-to-gopal-2023-pandemic-agents","subject":"kapoor-open-foundation-models-2024-02","predicate":"cites","object":{"kind":"entity","entityId":"gopal-2023-pandemic-agents"},"topic":"ideas","statement":"Kapoor, Bommasani and co-authors' paper of February 2024 cites Gopal and co-authors' paper as finding that open language models can generate accurate information about pandemic pathogens, and states that such information is publicly available without open language models.","time":{"kind":"event","date":"2024-02-27","basis":"publication","note":"Date of the arXiv v1 submission."},"derivation":"explicit","resolution":"supported","editorialState":"seed","evidenceIds":["evidence-rd-reply-kapoor-2024-open-foundation-models-to-gopal-2023-pandemic-agents-1"]}],"sources":[{"id":"source-rd-gopal-2023-pandemic-agents","documentId":"gopal-2023-pandemic-agents","title":"Will releasing the weights of large language models grant widespread access to pandemic agents?","authors":["Anjali Gopal","Nathan Helm-Burger","Lenni Justen","Emily H. Soice","Tiffany Tzeng","Geetha Jeyapragasan","Simon Grimm","Benjamin Mueller","Kevin M. Esvelt"],"publisher":"arXiv:2310.18233","publicationDate":"2023-10-25","version":"Retrieved for the candidate pack on 2026-10-29 (SHA-256 76930b27d12c6aac9f02b0bf7e7c0b83b2c8ca0f7840c9ef98e4729cb30894d6). arXiv v1 abstract page (the v1 PDF as retrieved has no text layer); quotation limited to the abstract. The cross-family check retrieved it again on 2026-10-31; the bytes differ, and the check compared the quoted passages.","evidenceUrl":"https://arxiv.org/abs/2310.18233v1","language":"en"}],"evidence":[{"id":"evidence-rd-r15-gopal-2023-pandemic-agents-1","claimId":"rd-r15-gopal-2023-pandemic-agents","sourceId":"source-rd-gopal-2023-pandemic-agents","sourceRole":"primary","support":"supports","verification":"machine_checked","retrievalRoute":"direct"},{"id":"evidence-rd-reply-kapoor-2024-open-foundation-models-to-gopal-2023-pandemic-agents-1","claimId":"rd-reply-kapoor-2024-open-foundation-models-to-gopal-2023-pandemic-agents","sourceId":"source-ab-kapoor-open-2024","sourceRole":"primary","support":"supports","verification":"machine_checked","retrievalRoute":"direct"}],"at":{"entities":[1241,1832,1893],"claims":[5303,5355],"sources":[1742],"evidence":[7120,7195]},"index":{"byClaim":[["rd-r15-gopal-2023-pandemic-agents",["propositions:risk-debate"]]],"marks":[["kapoor-open-foundation-models-2024-02",[{"collectionId":"ai-bio-arguments","propositionId":"ab-prop-open-weights-bio-risk","claimId":"ab-arg-d6-kapoor-contests","text":"Earliest located text contesting D6 Public release of model weights increases biological misuse risk in Arguments about AI and biological risk"}]]],"chronicle":{"years":[{"year":1863,"topics":{"ideas":5},"stated":0},{"year":1865,"topics":{"ideas":1},"stated":0},{"year":1872,"topics":{"ideas":7},"stated":0},{"year":1943,"topics":{"ideas":1},"stated":0},{"year":1947,"topics":{"ideas":2},"stated":0},{"year":1950,"topics":{"ideas":7},"stated":0},{"year":1951,"topics":{"ideas":5},"stated":0},{"year":1952,"topics":{"ideas":2},"stated":0},{"year":1955,"topics":{"ideas":31},"stated":0},{"year":1956,"topics":{"ideas":1},"stated":0},{"year":1957,"topics":{"ideas":1},"stated":0},{"year":1958,"topics":{"ideas":3},"stated":0},{"year":1959,"topics":{"ideas":6},"stated":0},{"year":1960,"topics":{"ideas":11},"stated":0},{"year":1961,"topics":{"ideas":10},"stated":0},{"year":1965,"topics":{"ideas":8},"stated":0},{"year":1966,"topics":{"ideas":20},"stated":0},{"year":1968,"topics":{"ideas":5},"stated":0},{"year":1969,"topics":{"ideas":2},"stated":0},{"year":1971,"topics":{"ideas":4},"stated":0},{"year":1972,"topics":{"ideas":1},"stated":0},{"year":1973,"topics":{"ideas":2},"stated":0},{"year":1974,"topics":{"ideas":2},"stated":0},{"year":1975,"topics":{"ideas":1},"stated":0},{"year":1976,"topics":{"ideas":1},"stated":0},{"year":1977,"topics":{"people":2,"ideas":8},"stated":0},{"year":1979,"topics":{"ideas":4},"stated":0},{"year":1980,"topics":{"ideas":2},"stated":0},{"year":1981,"topics":{"people":2},"stated":0},{"year":1982,"topics":{"ideas":4},"stated":0},{"year":1983,"topics":{"ideas":4},"stated":0},{"year":1984,"topics":{"ideas":21},"stated":0},{"year":1985,"topics":{"ideas":9},"stated":0},{"year":1986,"topics":{"ideas":18},"stated":0},{"year":1987,"topics":{"ideas":1},"stated":0},{"year":1988,"topics":{"ideas":6},"stated":0},{"year":1989,"topics":{"ideas":8},"stated":0},{"year":1990,"topics":{"ideas":5},"stated":0},{"year":1991,"topics":{"ideas":11},"stated":0},{"year":1992,"topics":{"ideas":9},"stated":0},{"year":1993,"topics":{"ideas":14,"people":3},"stated":0},{"year":1994,"topics":{"ideas":14},"stated":0},{"year":1995,"topics":{"ideas":10,"people":1},"stated":0},{"year":1996,"topics":{"ideas":71},"stated":0},{"year":1997,"topics":{"ideas":12},"stated":0},{"year":1998,"topics":{"ideas":49},"stated":0},{"year":1999,"topics":{"ideas":27,"people":1,"institutions":1},"stated":0},{"year":2000,"topics":{"ideas":62},"stated":0},{"year":2001,"topics":{"ideas":39},"stated":0},{"year":2002,"topics":{"ideas":30},"stated":0},{"year":2003,"topics":{"ideas":8},"stated":0},{"year":2004,"topics":{"ideas":12,"people":3},"stated":0},{"year":2005,"topics":{"ideas":10,"people":1},"stated":0},{"year":2006,"topics":{"ideas":26,"people":1},"stated":0},{"year":2007,"topics":{"ideas":20},"stated":0},{"year":2008,"topics":{"ideas":57,"people":3,"institutions":1},"stated":0},{"year":2009,"topics":{"ideas":10,"people":1},"stated":0},{"year":2010,"topics":{"people":3,"ideas":11,"institutions":1,"governance":4},"stated":0},{"year":2011,"topics":{"people":3,"ideas":7,"institutions":2},"stated":0},{"year":2012,"topics":{"people":4,"ideas":17,"institutions":2},"stated":0},{"year":2013,"topics":{"ideas":46,"people":4,"institutions":2,"capital":1},"stated":0},{"year":2014,"topics":{"institutions":2,"ideas":54,"people":5},"stated":0},{"year":2015,"topics":{"people":22,"ideas":122,"institutions":3,"capital":1},"stated":0},{"year":2016,"topics":{"ideas":88,"people":2},"stated":0},{"year":2017,"topics":{"people":16,"institutions":2,"ideas":128,"governance":2},"stated":0},{"year":2018,"topics":{"people":8,"ideas":158,"institutions":8,"governance":1},"stated":0},{"year":2019,"topics":{"capital":1,"compute":1,"people":10,"governance":19,"ideas":175,"institutions":4},"stated":0},{"year":2020,"topics":{"people":6,"ideas":98,"institutions":1,"governance":2},"stated":0},{"year":2021,"topics":{"people":27,"ideas":177,"compute":1,"institutions":23,"governance":4,"capital":6},"stated":0},{"year":2022,"topics":{"people":15,"ideas":217,"institutions":6,"governance":3,"compute":2,"capital":1},"stated":0},{"year":2023,"topics":{"capital":5,"compute":7,"institutions":23,"people":51,"governance":179,"ideas":389},"stated":0},{"year":2024,"topics":{"capital":12,"compute":19,"governance":282,"people":80,"ideas":178,"institutions":28},"stated":1},{"year":2025,"topics":{"governance":547,"compute":69,"capital":34,"people":90,"institutions":18,"ideas":178},"stated":7},{"year":2026,"topics":{"governance":442,"capital":8,"compute":32,"institutions":21,"ideas":91,"people":107},"stated":19},{"year":2027,"topics":{},"stated":9},{"year":2028,"topics":{},"stated":6},{"year":2029,"topics":{},"stated":3},{"year":2030,"topics":{},"stated":3},{"year":2032,"topics":{},"stated":2},{"year":2035,"topics":{},"stated":2},{"year":2039,"topics":{},"stated":1},{"year":2042,"topics":{},"stated":1},{"year":2050,"topics":{},"stated":1}],"scheduled":[],"statedBy":[]},"collections":[{"target":{"kind":"propositions","id":"superintelligence"},"title":"Propositions about superintelligence, 1863–2022","claimIds":[],"records":[]},{"target":{"kind":"propositions","id":"risk-debate"},"title":"Arguments about catastrophic risk from advanced AI","claimIds":["rd-r15-gopal-2023-pandemic-agents"],"records":[]},{"target":{"kind":"propositions","id":"yudkowsky-arguments"},"title":"Eliezer Yudkowsky’s arguments on common claims about AI, 1996–2026","claimIds":[],"records":[]},{"target":{"kind":"propositions","id":"economics-of-machine-intelligence"},"title":"Economics of machine intelligence","claimIds":[],"records":[]},{"target":{"kind":"propositions","id":"orbital-compute-arguments"},"title":"Arguments about compute in orbit","claimIds":[],"records":[]},{"target":{"kind":"propositions","id":"ai-bio-arguments"},"title":"Arguments about AI and biological risk","claimIds":[],"records":[]},{"target":{"kind":"propositions","id":"ai-in-science"},"title":"AI in science","claimIds":[],"records":[]},{"target":{"kind":"documents"},"title":"Frontier safety frameworks","claimIds":[]},{"target":{"kind":"compare","id":"frontier-safety-frameworks"},"title":"Compare frameworks","claimIds":[]},{"target":{"kind":"control","id":"openai"},"title":"OpenAI’s control structure, 2015–2026","claimIds":[]},{"target":{"kind":"control","id":"anthropic"},"title":"Anthropic’s control structure, 2021–2026","claimIds":[]},{"target":{"kind":"commitments"},"title":"External commitments and obligations","claimIds":[]},{"target":{"kind":"question","id":"frameworks-to-obligations"},"title":"Frameworks, commitments and legal obligations, 2023–2026","claimIds":[]},{"target":{"kind":"reading"},"title":"Founding and early leadership","claimIds":[]}]},"version":"131evrz"}