The paper describes its largest model, GPT-2, as a 1.5-billion-parameter Transformer and reports that it improves on previously reported results on 7 of 8 tested language modelling datasets in a zero-shot setting while still underfitting WebText.
One recorded claim. The claim panel gives its qualification, the source passages with their place in each source, and how it was checked.
What it connects
Language Models are Unsupervised Multitask Learners → states its contribution → The paper describes its largest model, GPT-2, as a 1.5-billion-parameter Transformer and reports that it improves on previously reported results on 7 of 8 tested language modelling datasets in a zero-shot setting while still underfitting WebText.
Where it appears
No collection page holds this claim. It is listed with its records in the explorer.