Document · Research paper

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Work-level record. Its arXiv versions and any conference or journal version are listed as sources, each with its own date. A citation to the work does not identify which version the citing author read.

Issued by

No issuing record yet. A missing record is a gap in coverage.

Authors credited

Jacob Devlin · Kenton Lee · Kristina Toutanova · Ming-Wei Chang

Dates

Published 2018-10-11 authorship evidence authorship evidence authorship evidence authorship evidence

Exact source

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Association for Computational Linguistics · published 2019-06 · NAACL-HLT 2019, Volume 1 (Long and Short Papers), pp. 4171–4186. Located by the cross-family machine check on 2026-10-30 (item A025; Volume, month, year), at the precision of its source; not read again at admission.
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding arXiv · published 2018-10-11 · arXiv abstract page, retrieved for the candidate pack on 2026-10-28 (SHA-256 dab568b0a86ade336c02d873fa9156dc8da5d7326b1ba04cedf21f96f0f46aac). Submission history as arXiv records it (UTC): v1 11 October 2018; v2 24 May 2019. The page serves the latest version; each version is a separate expression, and only the one a record names was read.
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding arXiv · published 2018-10-11 · arXiv:1810.04805v1, submitted 11 October 2018 (UTC). Retrieved for the candidate pack on 2026-10-28 (SHA-256 58534a3c000cbcc60ed64e999a2d9ed839edc2d9894e4449e9d79e1118b5e5ba). The author list is the byline as printed on the first page.

Appears in

No collection holds a record about this document yet.

Versions

No other versions of this document are recorded. The evidence applies to the source version listed above. Other versions, such as a preprint, working paper or journal publication, are not identified or substituted.

Issue and authorship records

Documentary relations

Each relation is listed separately. Citing, crediting and reporting the use of a method are different acts, and none of them shows agreement or influence by itself.

Cited by · 11

Recorded documents that explicitly reference this one. A citation to a work does not identify which version was read.

Reports using a method from · 1

Methods this document reports using in its own study. Reported use is not independently verified implementation.

Attention Is All You NeedDevlin, Chang, Lee and Toutanova (arXiv v1, 2018) report that BERT's architecture is a multi-layer bidirectional Transformer encoder based on Vaswani et al.'s original implementation.2018-10-11 · event · Stated in source · Supported Inspect claim & evidence ↗Attention Is All You Need: document page →

Not recorded for this document: cites · explicitly credits · method reported as used by · applies parts of · parts applied by · discusses · reports evaluation of. A missing record does not show that the relation does not exist.

What the document says it adds

The document’s own description of its contribution, quoted from the version each row names. A claim to be the first is the document’s claim; Selekoa does not assess it.

In its own wordsThe paper introduces a language representation model called BERT (Bidirectional Encoder Representations from Transformers).“We introduce a new language representation model called BERT, which stands for Bidirectional Encoder Representations from Transformers.” arXiv v1, PDF p. 1, abstract2018-10-11 · publication · Stated in source · Supported Inspect claim & evidence ↗