Document · Research paper

LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code

Work-level record. Its arXiv versions and any conference or journal version are listed as sources, each with its own date. A citation to the work does not identify which version the citing author read.

Issued by

No issuing record yet. A missing record is a gap in coverage.

Authors credited

No authorship claim recorded yet. The source records list arXiv, Naman Jain, King Han, Alex Gu, Wen-Ding Li, Fanjia Yan, Tianjun Zhang, Sida I. Wang, Armando Solar-Lezama, Koushik Sen and Ion Stoica.

Dates

No date claim recorded yet. The source records give the publication date as 2024-03-12.

Exact source

LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code arXiv · published 2024-03-12 · arXiv abstract page, retrieved for the candidate pack on 2026-10-28 (SHA-256 89fce622b5717145123e215947cbd8e14fafbef92438e7193006fec974b5fff8). Submission history as arXiv records it (UTC): v1 12 March 2024; v2 6 June 2024. The page serves the latest version; each version is a separate expression, and only the one a record names was read.
LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code arXiv · published 2024-03-12 · arXiv:2403.07974v1, submitted 12 March 2024 (UTC). Retrieved for the candidate pack on 2026-10-28 (SHA-256 5b0a4889d135a23c5477434af276a78e5578bdfa33a2750925a2e527940e4ff5). The author list is the byline as printed on the first page.

Appears in

No collection holds a record about this document yet.

Versions

No other versions of this document are recorded. The evidence applies to the source version listed above. Other versions, such as a preprint, working paper or journal publication, are not identified or substituted.

Documentary relations

Each relation is listed separately. Citing, crediting and reporting the use of a method are different acts, and none of them shows agreement or influence by itself.

Cited by · 7

Recorded documents that explicitly reference this one. A citation to a work does not identify which version was read.

Not recorded for this document: cites · explicitly credits · reports using a method from · method reported as used by · applies parts of · parts applied by · discusses · reports evaluation of. A missing record does not show that the relation does not exist.

What the document says it adds

The document’s own description of its contribution, quoted from the version each row names. A claim to be the first is the document’s claim; Selekoa does not assess it.

In its own wordsThe paper proposes LiveCodeBench, which it describes as a comprehensive and contamination-free evaluation of LLMs for code that continuously collects new problems from contests on LeetCode, AtCoder and CodeForces.“In this work, we propose LiveCodeBench, a comprehensive and contamination-free evaluation of LLMs for code, which continuously collects new problems over time from contests across three competition platforms, namely LeetCode, AtCoder, and CodeForces.” arXiv v1, PDF p. 1, abstract2024-03-12 · publication · Stated in source · Supported Inspect claim & evidence ↗