Document · Research paper

Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity

Work-level record. Its arXiv versions and any conference or journal version are listed as sources, each with its own date. A citation to the work does not identify which version the citing author read.

Issued by

No issuing record yet. A missing record is a gap in coverage.

Authors credited

Barret Zoph · Liam Fedus · Noam Shazeer

Dates

Published 2021-01-11 authorship evidence authorship evidence authorship evidence

Exact source

Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity arXiv · published 2021-01-11 · arXiv abstract page, retrieved for the candidate pack on 2026-10-28 (SHA-256 3a6496323b841d8fe79e5026614930e69ba594a480cc0d72c70c47a2869f5c6a). Submission history as arXiv records it (UTC): v1 11 January 2021; v2 30 April 2022; v3 16 June 2022. The page serves the latest version; each version is a separate expression, and only the one a record names was read.
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity arXiv · published 2021-01-11 · arXiv:2101.03961v1, submitted 11 January 2021 (UTC). Retrieved for the candidate pack on 2026-10-28 (SHA-256 0dba4abc34422f49a5363f63c90d2103e4a982c921c597b8c3560cc34fd80d9c). The author list is the byline as printed on the first page.

Appears in

No collection holds a record about this document yet.

Versions

No other versions of this document are recorded. The evidence applies to the source version listed above. Other versions, such as a preprint, working paper or journal publication, are not identified or substituted.

Issue and authorship records

Documentary relations

Each relation is listed separately. Citing, crediting and reporting the use of a method are different acts, and none of them shows agreement or influence by itself.

Cited by · 7

Recorded documents that explicitly reference this one. A citation to a work does not identify which version was read.

Not recorded for this document: cites · explicitly credits · reports using a method from · method reported as used by · applies parts of · parts applied by · discusses · reports evaluation of. A missing record does not show that the relation does not exist.

What the document says it adds

The document’s own description of its contribution, quoted from the version each row names. A claim to be the first is the document’s claim; Selekoa does not assess it.