Claim · 2025-04-29 · publication · Stated in source · Supported

The Virology Capabilities Test paper states that it presents a large language model benchmark measuring the capability to troubleshoot complex virology laboratory protocols, built from the inputs of dozens of expert virologists.

One recorded claim. The claim panel gives its qualification, the source passages with their place in each source, and how it was checked.

What it connects

Virology Capabilities Test (VCT): A Multimodal Virology Q&A Benchmark (arXiv:2504.16137) → reports evaluation of →

Where it appears

No collection page holds this claim. It is listed with its records in the explorer.

Claim and evidence

Virology Capabilities Test (VCT): A Multimodal Virology Q&A Benchmark (arXiv:2504.16137)reports evaluation of ↓

Machine-checked, not reviewed by an editorStated in sourceSupported

Supporting evidence: primary · 1 source

Subject version: Version 2 of 29 April 2025, as described on the arXiv abstract page · Published 2025-04-21 · Effective date not established · Revised 2025-04-29
Date: 2025-04-29 · publication

Scope and limitsRecords what the benchmark states it measures, as described in its abstract, not any finding about a system. Only the abstract page was read; the paper's construction and contents were not inspected. The quoted phrase is the benchmark's own statement of what it measures and is required to identify it; no question, protocol or procedure is recorded, and the paper body was deliberately not read.

The evidence 01

primary sourceSupports the claim

arXiv abstract page for arXiv:2504.16137 (Virology Capabilities Test (VCT): A Multimodal Virology Q&A Benchmark)

arXiv (Cornell University) · Publication date unknown

Cite the original source

Cite the original document, not Selekoa. Check these details against it.

Source excerpt

“a large language model (LLM) benchmark that measures the capability to troubleshoot complex virology laboratory protocols”

Location in source Abstract, first two sentences

How it was read Retrieved directly from the publisher

Machine-checked · 2026-10-30

Source details and check notes

Authors: arXiv (Cornell University)
Version: Retrieved for the candidate pack on 2026-10-28 (SHA-256 3ad6043cc84942ab180140c67ad4e128b37899ee1e4fc957d8f80d93a80d4898). Abstract page as served on 2026-10-28, listing v1 of 21 April 2025 and v2 of 29 April 2025 (the current version). Only the abstract page was read; the full paper was not retrieved, so no record rests on its body. Retrieved again at admission on 2026-10-30 (SHA-256 cc6f6960f2503c7789a77800e49cac2de3af708305ca7f232a5322507a12bc80). Its wording can change; earlier wording is not authenticated.
Canonical address: Open the canonical source ↗
Accessed: 2026-10-28
Language: English (en)
Attribution: arXiv (Cornell University), “arXiv abstract page for arXiv:2504.16137 (Virology Capabilities Test (VCT): A Multimodal Virology Q&A Benchmark)”.
Reuse: No open redistribution licence asserted. Bibliographic metadata, editorial paraphrases and short attributed quotations (at most 50 words each). Recheck terms before wider redistribution.
Check notes: Candidate pack passage, AI and biosecurity (research/ai-bio). The quotation (16 words) matched the text retrieved for the candidate pack on 2026-10-28 and again at admission on 2026-10-30, in a fresh retrieval (SHA-256 cc6f6960f2503c7789a77800e49cac2de3af708305ca7f232a5322507a12bc80; the bytes differ from the pack’s retrieval). Matching ignored differences of whitespace, case, quotation marks, dashes and Unicode compatibility forms, so the source’s typography can differ. The abstract adds that the benchmark was constructed from the inputs of dozens of PhD-level expert virologists. A cross-family machine check (2026-10-30, item 27) re-read the record’s sources and found full support. No human editorial review.

Status and meaning

Editorial status. Not reviewed by an editor. An exploratory record that no editor has accepted. This status does not say whether a person has read any linked passage. Each evidence record above shows how it was checked.

Relation. A document names a concept as an evaluation category. This is not a finding that the evaluated system exhibits the property.

Date. Version 2 of the preprint, as described on the arXiv abstract page; version 1 was submitted on 21 April 2025.

Record ID ab-ev-vct-benchmark-measures