Claim · 2024-04-13 · publication · Stated in source · Supported

Marcus's post of April 2024 reads benchmark results from GPT-2 to GPT-4 Turbo as tentative evidence that large language models have reached a period of diminishing returns, and states that the wall he wrote of in 2022 may be approaching.

One recorded claim. The claim panel gives its qualification, the source passages with their place in each source, and how it was checked.

What it connects

Evidence that LLMs are reaching a point of diminishing returns - and what that might mean → articulates → Capabilities will plateau

Where it appears

Arguments about catastrophic risk from advanced AI →

Claim and evidence

Evidence that LLMs are reaching a point of diminishing returns - and what that might meanarticulates ↓Capabilities will plateau

Machine-checked, not reviewed by an editorStated in sourceSupported

Supporting evidence: primary · 1 source

Date: 2024-04-13 · publication Records dated 2024 →
Role: Articulation, Later restatement
Register (kind of text): Nonfiction

Scope and limitsThe post calls its own plots tentative and discusses the restriction-of-range problem in benchmarks; it is about LLMs, not about catastrophic risk.

The evidence 02

primary sourceSupports the claim

Evidence that LLMs are reaching a point of diminishing returns - and what that might mean

Marcus on AI (author's Substack) · 2024-04-13

Cite the original source

Cite the original document, not Selekoa. Check these details against it.

Source excerpt

“Instead, I see numerous signs that we have reached a period of diminishing returns.”

Location in source Paragraph after the opening discussion of Mollick

How it was read Retrieved directly from the publisher

Machine-checked · 2026-10-31

Source details and check notes

Authors: Gary Marcus
Version: Retrieved for the candidate pack on 2026-10-29 (SHA-256 ff3b3fdf0252907883facf0d0c04a140339f896223e810b11e5a47b29a391332). Current Substack page, dated 2024-04-13 in its metadata; retrieved 2026-10-29.
Canonical address: Open the canonical source ↗
Accessed: 2026-10-29
Language: English (en)
Attribution: Gary Marcus, “Evidence that LLMs are reaching a point of diminishing returns - and what that might mean”, 2024-04-13.
Reuse: No open redistribution licence asserted. Bibliographic metadata, editorial paraphrases and short attributed quotations (at most 50 words each). Recheck terms before wider redistribution.
Check notes: Candidate pack passage, arguments about catastrophic risk from advanced AI (research/risk-debate). The quotation (14 words) matched the text retrieved for the candidate pack on 2026-10-29. Matching ignored differences of whitespace, case, quotation marks, dashes and Unicode compatibility forms, so the source’s typography can differ. No human editorial review.

primary sourceSupports the claim

Evidence that LLMs are reaching a point of diminishing returns - and what that might mean

Marcus on AI (author's Substack) · 2024-04-13

Cite the original source

Cite the original document, not Selekoa. Check these details against it.

Source excerpt

“The wall that I once warned about, in 2022, may finally be approaching.”

Location in source Paragraph after the second graph

How it was read Retrieved directly from the publisher

Machine-checked · 2026-10-31

Source details and check notes

Authors: Gary Marcus
Version: Retrieved for the candidate pack on 2026-10-29 (SHA-256 ff3b3fdf0252907883facf0d0c04a140339f896223e810b11e5a47b29a391332). Current Substack page, dated 2024-04-13 in its metadata; retrieved 2026-10-29.
Canonical address: Open the canonical source ↗
Accessed: 2026-10-29
Language: English (en)
Attribution: Gary Marcus, “Evidence that LLMs are reaching a point of diminishing returns - and what that might mean”, 2024-04-13.
Reuse: No open redistribution licence asserted. Bibliographic metadata, editorial paraphrases and short attributed quotations (at most 50 words each). Recheck terms before wider redistribution.
Check notes: Candidate pack passage, arguments about catastrophic risk from advanced AI (research/risk-debate). The quotation (13 words) matched the text retrieved for the candidate pack on 2026-10-29. Matching ignored differences of whitespace, case, quotation marks, dashes and Unicode compatibility forms, so the source’s typography can differ. No human editorial review.

Status and meaning

Editorial status. Not reviewed by an editor. An exploratory record that no editor has accepted. This status does not say whether a person has read any linked passage. Each evidence record above shows how it was checked.

Relation. A passage of the document meets the proposition’s criterion. The record documents what the text states, in its register (fiction and satire are labelled); it is not evidence that the proposition is true and implies no influence on or from another text.

Date. Date of posting.

Record ID rd-r13-marcus-2024-diminishing-returns