Claim and evidence Close ×
U.S. AI Safety Institute documented evaluation engagement with ↓ OpenAI NIST states that US AISI and UK AISI conducted a joint pre-deployment evaluation of OpenAI's o1 across three domains including biological capabilities, and OpenAI's own system card states that pre-deployment evaluations by the two institutes were conducted on a version of o1 and are not included in the card. Copy claim link
Copy claim reference
Machine-checked, not reviewed by an editor Stated in source Supported
Supporting evidence: primary · 2 sources
Date 2024-12-18 · publication Activity stage reported performed Evaluated system OpenAI o1, released 5 December 2024 Activity scope Joint pre-deployment evaluation of o1 across cyber capabilities, biological capabilities, and software and AI development Scope and limits Reported performed work, documented by both the evaluating body and the developer. It does not establish the depth of the testing, and the detailed technical report was not retrieved. In the biological domain the published findings are US AISI's only.
The evidence 02 primary source Supports the claim
Pre-Deployment Evaluation of OpenAI’s o1 Model (December 18, 2024) ↗ National Institute of Standards and Technology · 2024-12-18
Archived copy, captured 2024-12-19: Pre-Deployment Evaluation of OpenAI’s o1 Model (December 18, 2024) ↗
Copy source reference
Cite the original source Cite the original document, not Selekoa. Check these details against it.
Copy APA
Download BibTeX Download RIS Download CSL-JSON
Source excerpt “US AISI and UK AISI ran separate but complementary tests to assess the model's capabilities across three domains: (1) cyber capabilities, (2) biological capabilities, (3) and software and AI development.” Location in source 'Overview of the Joint Safety Research & Testing Exercise'
How it was read Retrieved directly from the publisher
Machine-checked · 2026-10-30
Source details and check notes Authors National Institute of Standards and Technology (U.S. AI Safety Institute) Version Retrieved on 2026-10-27 (SHA-256 b2604d18a75f4b2ea52c3a6f70df54230fb62971a7bdbff96f1b15fb29ea4315). The cross-family check of 2026-10-28 opened the Internet Archive capture linked here and matched the quoted wording in it, the release-period expression (decision 9); a capture shows only what the archive retrieved that day. Canonical address Open the canonical source ↗ Accessed 2026-10-27 Language English (en) Archive copy Open archived copy, captured 2024-12-19: Pre-Deployment Evaluation of OpenAI’s o1 Model (December 18, 2024) ↗ . Captured 1 day after the recorded publication date. An archive copy shows only what the archive retrieved on 2024-12-19. It does not prove what the page said earlier, and it can differ from the copy checked on 2026-10-27.Attribution National Institute of Standards and Technology (U.S. AI Safety Institute), “Pre-Deployment Evaluation of OpenAI’s o1 Model (December 18, 2024)”, 2024-12-18. Reuse No open redistribution licence asserted. Bibliographic metadata, editorial paraphrases and short attributed quotations (at most 50 words each). Recheck terms before wider redistribution. Check notes Candidate pack passage, AI and biosecurity (research/ai-bio). The quotation (30 words) matched the text retrieved for the candidate pack on 2026-10-28 and again at admission on 2026-10-30, in a fresh retrieval (SHA-256 8f38bef33205a708d2246601bb0c39020aa5ed69c4b396a44284f7aa70799ece; the bytes differ from the pack’s retrieval). Matching ignored differences of whitespace, case, quotation marks, dashes and Unicode compatibility forms, so the source’s typography can differ. Quoted as printed, including the misplaced numbering. No human editorial review. primary source Supports the claim
OpenAI o1 System Card ↗ OpenAI · 2024-12-05
Archived copy, captured 2026-09-06: OpenAI o1 System Card ↗
Copy source reference
Cite the original source Cite the original document, not Selekoa. Check these details against it.
Copy APA
Download BibTeX Download RIS Download CSL-JSON
Source excerpt “a set of predeployment evaluations were conducted on a version of the o1 model by the U.S. AI Safety Institute (US AISI) and the UK Safety Institute (UK AISI), not included in this report” Location in source PDF p. 3, §4 Safety Evaluations, introductory paragraph
How it was read Retrieved directly from the publisher
Machine-checked · 2026-10-30
Source details and check notes Authors OpenAI Version Page labelled Updated: December 5, 2024; includes multiple evaluation periods Version date 2024-12-05 Canonical address Open the canonical source ↗ Accessed 2026-09-17 Language English (en) Archive copy Open archived copy, captured 2026-09-06: OpenAI o1 System Card ↗ . Captured 640 days after the recorded version date. An archive copy shows only what the archive retrieved on 2026-09-06. It does not prove what the page said earlier, and it can differ from the copy checked on 2026-09-17.Attribution OpenAI, OpenAI o1 System Card (2024-12-05). Reuse No open redistribution licence asserted. Bibliographic metadata, editorial paraphrases and minimal attributed excerpts only. Recheck terms before wider redistribution. Check notes Candidate pack passage, AI and biosecurity (research/ai-bio). The quotation (34 words) matched the text retrieved for the candidate pack on 2026-10-28 and again at admission on 2026-10-30, in a fresh retrieval whose SHA-256 equals the pack’s. Matching ignored differences of whitespace, case, quotation marks, dashes and Unicode compatibility forms, so the source’s typography can differ. The developer's own statement of the engagement. No human editorial review. Status and meaning Editorial status. Not reviewed by an editor . An exploratory record that no editor has accepted. This status does not say whether a person has read any linked passage. Each evidence record above shows how it was checked.
Relation. An evaluator’s explicitly documented, system-specific engagement with a developer. Proposed, announced and reported performed work are distinct activity stages. Reported performance does not independently verify execution, effectiveness or certification.
Date. Dated by the publication of the NIST summary; the testing took place during a limited period of pre-deployment access, which neither document dates. The expression checked is the NIST copy served on 2026-10-28, whose footer reads 'Released December 18, 2024, Updated February 4, 2025'; what the page was changed in on that date is not stated, and the record keeps the release date, not the update date. The o1 System Card expression checked is the PDF served at cdn.openai.com/o1-system-card-20241205.pdf on 2026-10-28, which carries a footnote in §3 ('Scope of testing') reading 'Section added after December 5th on 12/19/2024'; the served file is therefore a later expression than the card's stated date of 5 December 2024, the card does not say what else differs, and the record keeps the stated date.
Record ID ab-ev-usaisi-openai-o1-engagement