Found and cross-checked by machines · How this works →

Comparison · 16 questions · 20 cards

Model cards compared

A cell records what a card states. It does not show that an evaluation was run as described or that a safeguard works, and a shared question does not make two cards’ answers equivalent.

What does each frontier developer’s published system card, model card or safety report disclose, on the same questions for every card? Each row is one card. Each column is one question, worded so that it fits every card. The questions are Selekoa’s; a card’s own terms appear only in quotation marks. A card is the developer’s own account of its model: what it states is recorded as stated, not as an independent finding.

Download every cell as CSV

Question Q09Autonomy and AI R&D

Does the card report dangerous-capability evaluations for autonomy, self-replication, self-improvement or AI research and development?

Criterion: The card reports that evaluations in any of these domains were run and states their outcome category or threshold language (policy level only). Partly if evaluations are reported without any outcome or conclusion. Agentic task benchmarks reported only as product capability do not meet it.

What the statuses mean
Stated
A passage of the card meets the question’s criterion as worded. The scope or condition is in the note.
Stated, partly
A passage has what the criterion asks for in a weaker or narrower form than the criterion’s own words (for example, an evaluation referred to without its outcome, or testers described without being named). The note says which part is missing.
Not found in the recorded search
No passage meeting the criterion was found. The cell lists the sections read, the terms searched and every passage set aside, with the reason. It does not show that the developer did not do the thing asked about, or did not disclose it elsewhere.
Does not apply
The question does not arise for this card, for the reason given (for example, the card predates any framework of its developer, so no framework determination can be asked about).

What the card states, quoted from the expression read. A card is the developer’s own account: not evidence that an evaluation was run as described, that a safeguard works, or that a finding is independent.

Limits of this comparison
  • A card is the developer’s account of its own model. A cell records what the card states. It does not show that an evaluation was run as described, that a safeguard works, or that anyone checked the result independently.
  • Dangerous-capability evaluations are recorded at policy level only: whether an evaluation was run, its domain, the stated outcome and the threshold language. Methods, prompts, task contents and detailed results are not recorded.
  • The table compares and does not rank. Rows are in a fixed order, by developer and then by date, and there are no scores or totals.
  • Symbols are not to be summed. A row with many “stated” cells does not show that a developer disclosed more, and a shared question does not make two cards’ answers equivalent.
How we searched

The searches of 2 November 2026 covered releases dated 2023-01-01 to 2026-11-01 by the six developers whose frameworks are in Compare frameworks: Anthropic, Google DeepMind, Meta, Microsoft, OpenAI and xAI. They read each developer’s own index of cards where it has one (Anthropic’s system-card index, Google DeepMind’s model-card index, OpenAI’s Deployment Safety Hub), its repositories on GitHub and Hugging Face, its content hosts and the dataset’s own sources. Web searches were used only to find addresses. Every card located is listed in the pack’s inventory, about sixty in the population.

A card is a document the developer published as the system card, model card or safety report of a named model or model family, including addenda and updates published as cards. Technical reports, research papers, blog posts and product pages are not cards. Gemma, Gemini Robotics (with Gemini Robotics-ER 1.5, which outputs text), Phi and image-input models such as GPT-4V are in the population. Image, video, audio and embedding models, image-generation models, safety classifiers such as Llama Guard and Prompt Guard, screen-reading models and research checkpoints are outside it, and so is GPT-Rosalind-6, whose card says it uses GPT-6 Astra’s weights.

These twenty rows are the first batch. For each developer and calendar year from 2023 to 2026 they are the latest card of that year that reports the developer’s own evaluations. The collection’s rule, set by the maintainer on 2026-11-03, is wider: every card that cites the developer’s frontier safety framework or states a determination under it, and, for each developer, the latest card before its first framework edition. The other cards are to follow in batches of about eight.

Each card is dated as it prints its own date. A card that prints no date has no date here; a repository commit date is not a card date. Six cards show an earlier publication date on an index, publication or announcement page that has not yet been checked, and keep their own date until it is.

openai.com, x.ai, ai.meta.com and microsoft.ai refused direct retrieval of their web pages (HTTP 403 or 400). The cards’ PDF files on the developers’ content hosts were retrieved directly. The Internet Archive refused connections, so no archive copy was opened; a reviewer later found archive captures of eight cards by index search. On 2026-11-03 the address of Meta’s Code World Model Preparedness Report answered HTTP 403. Its quotations had matched the copy retrieved on 2026-11-02, which the reviewer retrieved again with the same checksum.

Five further documents were retrieved after the batch was drafted. The cross-family check of 2026-11-03 retrieved Meta’s Muse Spark Safety & Preparedness Report and OpenAI’s o3 Operator addendum; each is earlier than the card chosen for its year. Its second pass of the same day retrieved OpenAI’s Sora system card (dated 9 December 2024), xAI’s Grok-1 model card (no card date; it gives the model’s release as October 2023) and Meta’s Muse Spark Open model card (model release October 2026). None of the five is a row yet.

Every quotation was matched by machine against the retrieved card. A reviewer from a different model family checked a sample of 130 cells on 2026-11-03, 90 of them answered blind before comparison. The maintainer excluded six cells on chemical and biological evaluations from that check; they are marked “not cross-family checked”. The other 190 cells were checked within the drafting model family only. The maintainer decided the disagreements; one, on the GPT-4V release decision, went to a second pass, which kept the reviewer’s reading.

Anthropic

  1. Claude 2 model card

    Stated

    • “Neither ARC nor we believe that our current Claude models possess the dangerous capabilities (‘autonomous replication’ abilities) that ARC is aiming to detect”

      Section 2 'Evaluations and Red Teaming', PDF p. 2

    Note: The card states that ARC's safety audits addressed autonomous replication and that neither ARC nor Anthropic believes current Claude models have that capability. This is Anthropic's account; ARC's own report is not part of the card.

    Inspect sources and checks: Claude 2 model card, Q09 Autonomy and AI R&D
  2. Model Card Addendum: Claude 3.5 Haiku and Upgraded Claude 3.5 Sonnet

    Stated

    • “we deem our software engineering evaluations as currently sufficient for ruling out ASL-3 autonomy capabilities”

      Section 3.1.4 'Evaluating Computer Use for the Responsible Scaling Policy', PDF p. 9

    • “Based on our analysis, we judge that the upgraded Claude 3.5 Sonnet does not require ASL-3 safeguards at this time.”

      Section 3.2.1 'Results', PDF p. 10

    Note: The card states autonomy evaluations under the RSP, that its software engineering evaluations suffice to rule out ASL-3 autonomy capabilities, and that the developer judges the upgraded Claude 3.5 Sonnet not to require ASL-3 safeguards.

    Inspect sources and checks: Model Card Addendum: Claude 3.5 Haiku and Upgraded Claude 3.5 Sonnet, Q09 Autonomy and AI R&D
  3. System Card: Claude Opus 4.5

    Stated

    • “We judge that Claude Opus 4.5 could not fully automate an entry-level, remote-only research role at Anthropic.”

      Section 1.2.4.1 'On autonomy risks', PDF p. 13

    • “Claude Opus 4.5 has roughly reached the pre-defined thresholds we set for straightforward ASL-4 rule-out based on benchmark tasks.”

      Section 1.2.3 'AI Safety Level determination process', PDF p. 12

    Note: The card states AI R&D evaluations, that the AI R&D-4 threshold is not crossed, and that the rule-out drew also on an internal survey and qualitative impressions because benchmark rule-out thresholds were roughly reached.

    Inspect sources and checks: System Card: Claude Opus 4.5, Q09 Autonomy and AI R&D
  4. System Card: Claude Haiku 5.5

    Stated

    • “Autonomy threat model 2 is not applicable to Haiku 5.5.”

      Section 2.3.1.1 'How Haiku 5.5 affects or changes analysis from our most recent Risk Report', PDF p. 19

    • “As Claude Haiku 5.5 is much less capable than Opus 5.5 and does not push the capability frontier, we draw the same conclusion in this case.”

      Section 2.3.3 'Conclusion', PDF p. 20

    Note: The card states that the Autonomy-2 threshold is not crossed, carrying over the Claude Opus 5.5 System Card's conclusion on the basis of relative capability, and that Autonomy threat model 1 applies (Q11).

    Inspect sources and checks: System Card: Claude Haiku 5.5, Q09 Autonomy and AI R&D

Google DeepMind

  1. Gemini 3 Flash Model Card

    Not found in the recorded search

    Note: No dangerous-capability evaluation of autonomy, self-improvement or AI R&D was found. The card reports agentic benchmarks as product capability; they are set aside below.

    Open the search record: Gemini 3 Flash Model Card, Q09 Autonomy and AI R&D
  2. Gemini 4 Argon — Model Card

    Stated

    • “Gemini 4 Argon's performance remains below our CCL threshold.”

      Frontier safety table, ML R&D row, PDF p. 14 (printed p. 13)

    Note: The table gives 'CCL not reached' for ML R&D acceleration level 1 and ML R&D automation level 1, on the basis of an internal research engineering benchmark. The loss-of-control (stealth and situational awareness) result is recorded under Q11.

    Inspect sources and checks: Gemini 4 Argon — Model Card, Q09 Autonomy and AI R&D

Meta

  1. Llama 2 model card (MODEL_CARD.md, meta-llama/llama)

    Not found in the recorded search

    Note: No evaluation of autonomy, self-replication, self-improvement or AI research and development was found. The search is recorded below.

    Open the search record: Llama 2 model card (MODEL_CARD.md, meta-llama/llama), Q09 Autonomy and AI R&D
  2. Llama 3.3 model card (MODEL_CARD.md, meta-llama/llama-models)

    Stated, partly

    • “Our attack automation study focused on evaluating the capabilities of LLMs when used as autonomous agents in cyber offensive operations,”

      Responsibility & Safety, 'Critical and other risks', item 3 'Cyber attack enablement'

    Note: The card reports an attack-automation study of the Llama 3 family as autonomous agents in cyber operations, without an outcome or conclusion. The study is stated for the Llama 3 family, not for Llama 3.3 specifically. No evaluation of self-replication, self-improvement or AI research and development was found. Search for the rest of the criterion: Responsibility & Safety, all subsections; Benchmarks. Terms searched: “autonom”, “self-replic”, “self-improv”, “AI R&D”, “research and development”.

    Inspect sources and checks: Llama 3.3 model card (MODEL_CARD.md, meta-llama/llama-models), Q09 Autonomy and AI R&D
  3. Code World Model Preparedness Report

    Not found in the recorded search

    Note: No evaluation of autonomy, self-replication, self-improvement or AI research and development was found. The search is recorded below.

    Open the search record: Code World Model Preparedness Report, Q09 Autonomy and AI R&D
  4. Muse Spark 1.3 Evaluation Report

    Stated

    • “We assess Muse Spark 1.3 as “moderate or lower” for acceleration of AI development.”

      Section 2.3.1.1 Acceleration of AI Development, PDF p. 35 (printed p. 34)

    Note: The report states AI R&D evaluations under its Loss of Control domain with a 'moderate or lower' outcome.

    Inspect sources and checks: Muse Spark 1.3 Evaluation Report, Q09 Autonomy and AI R&D

Microsoft

  1. Phi-2 model card (README.md, microsoft/phi-2)

    Not found in the recorded search

    Note: No evaluation of autonomy, self-replication, self-improvement or AI research and development was found. The search is recorded below.

    Open the search record: Phi-2 model card (README.md, microsoft/phi-2), Q09 Autonomy and AI R&D
  2. Phi-4 model card (README.md, microsoft/phi-4)

    Not found in the recorded search

    Note: No evaluation of autonomy, self-replication, self-improvement or AI research and development was found. The search is recorded below.

    Open the search record: Phi-4 model card (README.md, microsoft/phi-4), Q09 Autonomy and AI R&D
  3. Phi-4-mini-flash-reasoning model card (README.md, microsoft/Phi-4-mini-flash-reasoning)

    Not found in the recorded search

    Note: No evaluation of autonomy, self-replication, self-improvement or AI research and development was found. The search is recorded below.

    Open the search record: Phi-4-mini-flash-reasoning model card (README.md, microsoft/Phi-4-mini-flash-reasoning), Q09 Autonomy and AI R&D
  4. MAI-Cyber-1.1-Flash model card

    Not found in the recorded search

    Note: No evaluation of autonomy, self-replication, self-improvement or AI research and development was found. The search is recorded below.

    Open the search record: MAI-Cyber-1.1-Flash model card, Q09 Autonomy and AI R&D

OpenAI

  1. GPT-4V(ision) System Card

    Stated, partly

    • “In the GPT-4 System Card, we explored additional risk areas of CBRN, weapons development, system interaction, and emergent risky properties such as self-replication.”

      Footnote 2, §2.3, PDF p. 6

    • “GPT-4V inherits the assessment in those areas, but this was not a key focus area as image input does not meaningfully alter the capabilities for these categories.”

      Footnote 2, §2.3, PDF p. 6

    Note: The card states that GPT-4V inherits the GPT-4 System Card’s assessment of emergent risky properties such as self-replication, without restating its outcome; no autonomy or AI R&D evaluation of GPT-4V is reported. Search for the rest of the criterion: Whole card. Terms searched: “self-replication”, “autonom”, “agent”, “power-seeking”, “R&D”.

    Inspect sources and checks: GPT-4V(ision) System Card, Q09 Autonomy and AI R&D
  2. o1 system card · 2024

    Stated

    • “Model Autonomy Score for o1: Low (same as o1-preview) Summary: o1 does not advance self-exfiltration, self-improvement, or resource acquisition capabilities sufficiently to indicate medium risk.”

      §5.8 Model Autonomy, PDF p. 34

    Note: Model autonomy: Low. The card also reports METR’s evaluation of an earlier checkpoint on agentic tasks (§4.4.4), with METR’s caveats.

    Inspect sources and checks: o1 system card · 2024, Q09 Autonomy and AI R&D
  3. Addendum to GPT-5.2 System Card: GPT-5.2-Codex

    Stated

    • “GPT-5.2-Codex performed at a similar capability level to GPT-5.2-Thinking and did not meet our High thresholds.”

      §5.1.3 AI Self-Improvement, PDF p. 17 (printed p. 16)

    • “performance in the evaluations below indicate we can rule this out for GPT-5.2-Codex.”

      §5.1.3 AI Self-Improvement, PDF p. 17 (printed p. 16)

    Note: AI self-improvement: below High, with four evaluations reported.

    Inspect sources and checks: Addendum to GPT-5.2 System Card: GPT-5.2-Codex, Q09 Autonomy and AI R&D
  4. Addendum to GPT-6 Luna System Card: October 29, 2026 Update

    Stated, partly

    • “In AI Self-Improvement, GPT-6 Sol and GPT-6 Luna do not reach our High threshold.”

      §8.1.3 AI Self-Improvement Capabilities, PDF p. 15 (printed p. 14)

    • “please see the AI Self-Improvement Capabilities section in the GPT-6 Astra card.”

      §8.1.3, PDF p. 15 (printed p. 14)

    Note: The card states the outcome (below High) but reports no AI self-improvement evaluation run on the October 29 model; it refers to the GPT-6 Astra card for the evaluations.

    Inspect sources and checks: Addendum to GPT-6 Luna System Card: October 29, 2026 Update, Q09 Autonomy and AI R&D

xAI

  1. Grok 4.1 Model Card

    Not found in the recorded search

    Note: No evaluation of autonomy, self-replication, self-improvement or AI R&D was found.

    Open the search record: Grok 4.1 Model Card, Q09 Autonomy and AI R&D
  2. Model Card: Grok 4.7

    Not found in the recorded search

    Note: No dangerous-capability evaluation of autonomy, self-replication, self-improvement or AI R&D was found; the card's autonomy statements concern product capability.

    Open the search record: Model Card: Grok 4.7, Q09 Autonomy and AI R&D