Evaluating Large Language Models Trained on Code
Work-level record. Its arXiv versions and any conference or journal version are listed as sources, each with its own date. A citation to the work does not identify which version the citing author read.
- Issued by
- No issuing record yet. A missing record is a gap in coverage.
- Authors credited
- Alec Radford · Bob McGrew · Dario Amodei · Greg Brockman · Igor Babuschkin · Ilya Sutskever · Jan Leike · Jared Kaplan · Joshua Achiam · Łukasz Kaiser · Mark Chen · Miles Brundage · Mira Murati · Nicholas Joseph · Pamela Mishkin · Sam McCandlish · Scott Gray · Wojciech Zaremba
- Dates
- Published 2021-07-07 authorship evidence authorship evidence authorship evidence authorship evidence authorship evidence authorship evidence authorship evidence authorship evidence authorship evidence authorship evidence authorship evidence authorship evidence authorship evidence authorship evidence authorship evidence authorship evidence authorship evidence authorship evidence
- Exact source
- Evaluating Large Language Models Trained on Code (arXiv:2107.03374v1) arXiv · published 2021-07-07 · Dated document, retrieved on 2026-10-15 (SHA-256 7085950bcce34fee8ee1821ed1ac0c2672e13708ec866810f997c0bf467d5009) directly from the publisher. The author list is the byline as printed on the first page, read for the key papers pack on 2026-10-28.
- Evaluating Large Language Models Trained on Code arXiv · published 2021-07-07 · arXiv abstract page, retrieved for the candidate pack on 2026-10-28 (SHA-256 6146efca3f74a7b080925557c49653351071d47afed54a9689160c1d426b5ac6). Submission history as arXiv records it (UTC): v1 7 July 2021; v2 14 July 2021. The page serves the latest version; each version is a separate expression, and only the one a record names was read.
Appears in
No collection holds a record about this document yet.
Versions
No other versions of this document are recorded. The evidence applies to the source version listed above. Other versions, such as a preprint, working paper or journal publication, are not identified or substituted.
Issue and authorship records
- Author: Alec RadfordAlec Radford is a credited author of Evaluating Large Language Models Trained on Code.2021-07-07 · publication · Stated in source · Supported Inspect claim & evidence ↗Alec Radford: person page →
- Author: Bob McGrewBob McGrew is a credited author of Evaluating Large Language Models Trained on Code.2021-07-07 · publication · Stated in source · Supported Inspect claim & evidence ↗Bob McGrew: person page →
- Author: Dario AmodeiDario Amodei is a credited author of Evaluating Large Language Models Trained on Code.2021-07-07 · publication · Stated in source · Supported Inspect claim & evidence ↗Dario Amodei: person page →
- Author: Greg BrockmanGreg Brockman is a credited author of Evaluating Large Language Models Trained on Code.2021-07-07 · publication · Stated in source · Supported Inspect claim & evidence ↗Greg Brockman: person page →
- Author: Igor BabuschkinIgor Babuschkin is a credited author of Evaluating Large Language Models Trained on Code.2021-07-07 · publication · Stated in source · Supported Inspect claim & evidence ↗Igor Babuschkin: person page →
- Author: Ilya SutskeverIlya Sutskever is a credited author of Evaluating Large Language Models Trained on Code.2021-07-07 · publication · Stated in source · Supported Inspect claim & evidence ↗Ilya Sutskever: person page →
- Author: Jan LeikeJan Leike is a credited author of Evaluating Large Language Models Trained on Code.2021-07-07 · publication · Stated in source · Supported Inspect claim & evidence ↗Jan Leike: person page →
- Author: Jared KaplanJared Kaplan is a credited author of Evaluating Large Language Models Trained on Code.2021-07-07 · publication · Stated in source · Supported Inspect claim & evidence ↗Jared Kaplan: person page →
- Author: Joshua AchiamJosh Achiam is a credited author of Evaluating Large Language Models Trained on Code.2021-07-07 · publication · Stated in source · Supported Inspect claim & evidence ↗Joshua Achiam: person page →
- Author: Łukasz KaiserLukasz Kaiser is a credited author of Evaluating Large Language Models Trained on Code.2021-07-07 · publication · Stated in source · Supported Inspect claim & evidence ↗Łukasz Kaiser: person page →
- Author: Mark ChenMark Chen is a credited author of Evaluating Large Language Models Trained on Code.2021-07-07 · publication · Stated in source · Supported Inspect claim & evidence ↗Mark Chen: person page →
- Author: Miles BrundageMiles Brundage is a credited author of Evaluating Large Language Models Trained on Code.2021-07-07 · publication · Stated in source · Supported Inspect claim & evidence ↗Miles Brundage: person page →
- Author: Mira MuratiMira Murati is a credited author of Evaluating Large Language Models Trained on Code.2021-07-07 · publication · Stated in source · Supported Inspect claim & evidence ↗Mira Murati: person page →
- Author: Nicholas JosephNicholas Joseph is a credited author of Evaluating Large Language Models Trained on Code.2021-07-07 · publication · Stated in source · Supported Inspect claim & evidence ↗Nicholas Joseph: person page →
- Author: Pamela MishkinPamela Mishkin is a credited author of Evaluating Large Language Models Trained on Code.2021-07-07 · publication · Stated in source · Supported Inspect claim & evidence ↗Pamela Mishkin: person page →
- Author: Sam McCandlishSam McCandlish is a credited author of Evaluating Large Language Models Trained on Code.2021-07-07 · publication · Stated in source · Supported Inspect claim & evidence ↗Sam McCandlish: person page →
- Author: Scott GrayScott Gray is a credited author of Evaluating Large Language Models Trained on Code.2021-07-07 · publication · Stated in source · Supported Inspect claim & evidence ↗Scott Gray: person page →
- Author: Wojciech ZarembaWojciech Zaremba is a credited author of Evaluating Large Language Models Trained on Code.2021-07-07 · publication · Stated in source · Supported Inspect claim & evidence ↗Wojciech Zaremba: person page →
Documentary relations
Each relation is listed separately. Citing, crediting and reporting the use of a method are different acts, and none of them shows agreement or influence by itself.
Cites · 5
Explicit references in this document. Citation is neither agreement nor influence.
- BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingEvaluating Large Language Models Trained on Code (arXiv:2107.03374v1) cites BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding.2021-07-07 · publication · Stated in source · Supported Inspect claim & evidence ↗BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding: document page →
- Deep contextualized word representationsEvaluating Large Language Models Trained on Code (arXiv:2107.03374v1) cites Deep contextualized word representations.2021-07-07 · publication · Stated in source · Supported Inspect claim & evidence ↗Deep contextualized word representations: document page →
- Exploring the Limits of Transfer Learning with a Unified Text-to-Text TransformerEvaluating Large Language Models Trained on Code (arXiv:2107.03374v1) cites Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer.2021-07-07 · publication · Stated in source · Supported Inspect claim & evidence ↗Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer: document page →
- Language Models are Few-Shot LearnersEvaluating Large Language Models Trained on Code (arXiv:2107.03374v1) cites Language Models are Few-Shot Learners.2021-07-07 · publication · Stated in source · Supported Inspect claim & evidence ↗Language Models are Few-Shot Learners: document page →
- RoBERTa: A Robustly Optimized BERT Pretraining ApproachEvaluating Large Language Models Trained on Code (arXiv:2107.03374v1) cites RoBERTa: A Robustly Optimized BERT Pretraining Approach.2021-07-07 · publication · Stated in source · Supported Inspect claim & evidence ↗RoBERTa: A Robustly Optimized BERT Pretraining Approach: document page →
Cited by · 16
Recorded documents that explicitly reference this one. A citation to a work does not identify which version was read.
- Training language models to follow instructions with human feedbackTraining language models to follow instructions with human feedback cites Evaluating Large Language Models Trained on Code.2022-03-04 · publication · Stated in source · Supported Inspect claim & evidence ↗Training language models to follow instructions with human feedback: document page →
- Self-critiquing models for assisting human evaluatorsSelf-critiquing models for assisting human evaluators cites Evaluating Large Language Models Trained on Code.2022-06-12 · publication · Stated in source · Supported Inspect claim & evidence ↗Self-critiquing models for assisting human evaluators: document page →
- LLaMA (2023 paper)LLaMA (2023 paper) cites Evaluating Large Language Models Trained on Code.2023-02-27 · publication · Stated in source · Supported Inspect claim & evidence ↗LLaMA (2023 paper): document page →
- GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language ModelsGPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Models cites Evaluating Large Language Models Trained on Code.2023-03-17 · publication · Stated in source · Supported Inspect claim & evidence ↗Eloundou et al., GPTs are GPTs (2023): document page →
- Qwen Technical ReportQwen Technical Report cites Evaluating Large Language Models Trained on Code.2023-09-28 · publication · Stated in source · Supported Inspect claim & evidence ↗Qwen Technical Report: document page →
- Gemini — Google DeepMind research introduction (2023)Gemini — Google DeepMind research introduction (2023) cites Evaluating Large Language Models Trained on Code.2023-12-06 · publication · Stated in source · Supported Inspect claim & evidence ↗Gemini — Google DeepMind research introduction (2023): document page →
- Gemini: A Family of Highly Capable Multimodal ModelsGemini: A Family of Highly Capable Multimodal Models cites Evaluating Large Language Models Trained on Code.2023-12-19 · publication · Stated in source · Supported Inspect claim & evidence ↗Gemini: A Family of Highly Capable Multimodal Models: document page →
- ChatGLM research history and techniquesChatGLM research history and techniques cites Evaluating Large Language Models Trained on Code.2024-06-18 · publication · Stated in source · Supported Inspect claim & evidence ↗ChatGLM research history and techniques: document page →
- DeepSeek-V3 Technical ReportDeepSeek-V3 Technical Report cites Evaluating Large Language Models Trained on Code.2024-12-27 · publication · Stated in source · Supported Inspect claim & evidence ↗DeepSeek-V3 Technical Report: document page →
- DeepSeek-R1 research reportDeepSeek-R1 research report cites Evaluating Large Language Models Trained on Code.2025-01-22 · publication · Stated in source · Supported Inspect claim & evidence ↗DeepSeek-R1 research report: document page →
- Seed-Coder: Let the Code Model Curate Data for ItselfSeed-Coder: Let the Code Model Curate Data for Itself cites Evaluating Large Language Models Trained on Code.2025-06-04 · publication · Stated in source · Supported Inspect claim & evidence ↗Seed-Coder: Let the Code Model Curate Data for Itself: document page →
- Kimi K2: Open Agentic IntelligenceKimi K2: Open Agentic Intelligence cites Evaluating Large Language Models Trained on Code.2025-07-28 · publication · Stated in source · Supported Inspect claim & evidence ↗Kimi K2: Open Agentic Intelligence: document page →
- ERNIE 5.0 Technical ReportERNIE 5.0 Technical Report cites Evaluating Large Language Models Trained on Code.2026-02-04 · publication · Stated in source · Supported Inspect claim & evidence ↗ERNIE 5.0 Technical Report: document page →
- Meta Advanced AI Scaling Framework — Version 2Meta Advanced AI Scaling Framework — Version 2 cites Evaluating Large Language Models Trained on Code.2026-04-08 · publication · Stated in source · Supported Inspect claim & evidence ↗Meta AASF · v2: document page →
- Claude 2 model cardClaude 2 model card cites Evaluating Large Language Models Trained on Code.Date unknown · Stated in source · Supported Inspect claim & evidence ↗Claude 2 model card: document page →
- GPT-4 System CardGPT-4 System Card cites Evaluating Large Language Models Trained on Code.Date unknown · Stated in source · Supported Inspect claim & evidence ↗GPT-4 System Card: document page →
Not recorded for this document: explicitly credits · reports using a method from · method reported as used by · applies parts of · parts applied by · discusses · reports evaluation of. A missing record does not show that the relation does not exist.
What the document says it adds
The document’s own description of its contribution, quoted from the version each row names. A claim to be the first is the document’s claim; Selekoa does not assess it.