Scaling Language Models: Methods, Analysis & Insights from Training Gopher
Work-level record. Its arXiv versions and any conference or journal version are listed as sources, each with its own date. A citation to the work does not identify which version the citing author read.
- Issued by
- No issuing record yet. A missing record is a gap in coverage.
- Authors credited
- Arthur Mensch · Demis Hassabis · Geoffrey Irving · Igor Babuschkin · Koray Kavukcuoglu · Laurent Sifre · Lisa Anne Hendricks · Oriol Vinyals · Toby Pohlen · Vladimir Mikulik
- Dates
- Exact source
- Scaling Language Models: Methods, Analysis & Insights from Training Gopher arXiv · published 2021-12-08 · arXiv abstract page, retrieved for the candidate pack on 2026-10-28 (SHA-256 47457237e2e7fc6dfd863923977afa1f58fce9ae63ae566b94cbe89ecbaea261). Submission history as arXiv records it (UTC): v1 8 December 2021; v2 21 January 2022. The page serves the latest version; each version is a separate expression, and only the one a record names was read.
- Scaling Language Models: Methods, Analysis & Insights from Training Gopher arXiv · published 2021-12-08 · arXiv:2112.11446v1, submitted 8 December 2021 (UTC). Retrieved for the candidate pack on 2026-10-28 (SHA-256 a7aa3b0c47a8cfda50a9c3e9c8b3dd53dbbd296103536b9cd80dc425672e73bc). The author list is the byline as printed on the first page.
Appears in
No collection holds a record about this document yet.
Versions
No other versions of this document are recorded. The evidence applies to the source version listed above. Other versions, such as a preprint, working paper or journal publication, are not identified or substituted.
Issue and authorship records
- Author: Arthur MenschArthur Mensch is a credited author of Scaling Language Models: Methods, Analysis & Insights from Training Gopher.2021-12-08 · publication · Stated in source · Supported Inspect claim & evidence ↗Arthur Mensch: person page →
- Author: Demis HassabisDemis Hassabis is a credited author of Scaling Language Models: Methods, Analysis & Insights from Training Gopher.2021-12-08 · publication · Stated in source · Supported Inspect claim & evidence ↗Demis Hassabis: person page →
- Author: Geoffrey IrvingGeoffrey Irving is a credited author of Scaling Language Models: Methods, Analysis & Insights from Training Gopher.2021-12-08 · publication · Stated in source · Supported Inspect claim & evidence ↗Geoffrey Irving: person page →
- Author: Igor BabuschkinIgor Babuschkin is a credited author of Scaling Language Models: Methods, Analysis & Insights from Training Gopher.2021-12-08 · publication · Stated in source · Supported Inspect claim & evidence ↗Igor Babuschkin: person page →
- Author: Koray KavukcuogluKoray Kavukcuoglu is a credited author of Scaling Language Models: Methods, Analysis & Insights from Training Gopher.2021-12-08 · publication · Stated in source · Supported Inspect claim & evidence ↗Koray Kavukcuoglu: person page →
- Author: Laurent SifreLaurent Sifre is a credited author of Scaling Language Models: Methods, Analysis & Insights from Training Gopher.2021-12-08 · publication · Stated in source · Supported Inspect claim & evidence ↗Laurent Sifre: person page →
- Author: Lisa Anne HendricksLisa Anne Hendricks is a credited author of Scaling Language Models: Methods, Analysis & Insights from Training Gopher.2021-12-08 · publication · Stated in source · Supported Inspect claim & evidence ↗Lisa Anne Hendricks: person page →
- Author: Oriol VinyalsOriol Vinyals is a credited author of Scaling Language Models: Methods, Analysis & Insights from Training Gopher.2021-12-08 · publication · Stated in source · Supported Inspect claim & evidence ↗Oriol Vinyals: person page →
- Author: Toby PohlenToby Pohlen is a credited author of Scaling Language Models: Methods, Analysis & Insights from Training Gopher.2021-12-08 · publication · Stated in source · Supported Inspect claim & evidence ↗Toby Pohlen: person page →
- Author: Vladimir MikulikVladimir Mikulik is a credited author of Scaling Language Models: Methods, Analysis & Insights from Training Gopher.2021-12-08 · publication · Stated in source · Supported Inspect claim & evidence ↗Vladimir Mikulik: person page →
Documentary relations
Each relation is listed separately. Citing, crediting and reporting the use of a method are different acts, and none of them shows agreement or influence by itself.
Cited by · 5
Recorded documents that explicitly reference this one. A citation to a work does not identify which version was read.
- Training language models to follow instructions with human feedbackTraining language models to follow instructions with human feedback cites Scaling Language Models: Methods, Analysis & Insights from Training Gopher.2022-03-04 · publication · Stated in source · Supported Inspect claim & evidence ↗Training language models to follow instructions with human feedback: document page →
- Training Compute-Optimal Large Language ModelsTraining Compute-Optimal Large Language Models cites Scaling Language Models: Methods, Analysis & Insights from Training Gopher.2022-03-29 · publication · Stated in source · Supported Inspect claim & evidence ↗Training Compute-Optimal Large Language Models: document page →
- LLaMA (2023 paper)LLaMA (2023 paper) cites Scaling Language Models: Methods, Analysis & Insights from Training Gopher.2023-02-27 · publication · Stated in source · Supported Inspect claim & evidence ↗LLaMA (2023 paper): document page →
- Qwen Technical ReportQwen Technical Report cites Scaling Language Models: Methods, Analysis & Insights from Training Gopher.2023-09-28 · publication · Stated in source · Supported Inspect claim & evidence ↗Qwen Technical Report: document page →
- Gemini: A Family of Highly Capable Multimodal ModelsGemini: A Family of Highly Capable Multimodal Models cites Scaling Language Models: Methods, Analysis & Insights from Training Gopher.2023-12-19 · publication · Stated in source · Supported Inspect claim & evidence ↗Gemini: A Family of Highly Capable Multimodal Models: document page →
Ideas attributed to this work by · 1
Recorded documents that attribute an argument, concept, term, finding or approach to this one. Each attribution is the citing document’s claim.
- Training Compute-Optimal Large Language ModelsHoffmann et al. (2022) attribute to Rae et al. (2021) the finding that improving loss by adding parameters has a negligible effect on unprompted toxic generation, and test whether it holds for compute-optimal training.2022-03-29 · publication · Stated in source · Supported Inspect claim & evidence ↗Training Compute-Optimal Large Language Models: document page →
Not recorded for this document: cites · explicitly credits · reports using a method from · method reported as used by · applies parts of · parts applied by · discusses · reports evaluation of. A missing record does not show that the relation does not exist.
What the document says it adds
The document’s own description of its contribution, quoted from the version each row names. A claim to be the first is the document’s claim; Selekoa does not assess it.