{"entities":[{"id":"th-sutton-barto-2018","name":"Reinforcement Learning: An Introduction (second edition)","type":"document"},{"id":"th-samuel-1959","name":"Some Studies in Machine Learning Using the Game of Checkers","type":"document","subtype":"Journal article","description":"Arthur L. Samuel, “Some Studies in Machine Learning Using the Game of Checkers”. IBM Journal of Research and Development 3 (3), pp. 210–229 (published July 1959). Crossref published-print date (published July 1959). Read in a later reprint; the IBM Journal text itself (IEEE Xplore) was not retrieved.","sourceIds":["source-th-d-samuel-1959","source-th-d-samuel-1959-crossref"]},{"id":"th-sutton-1988","name":"Learning to Predict by the Methods of Temporal Differences","type":"document"},{"id":"th-term-machine-learning","name":"'machine learning'","type":"concept"}],"claims":[{"id":"th-ml-samuel-1959","subject":"th-samuel-1959","predicate":"uses_term","object":{"kind":"entity","entityId":"th-term-machine-learning"},"topic":"ideas","statement":"Samuel's IBM Journal paper of July 1959 uses \"machine learning\" in its title and abstract for programming a computer to learn to play checkers.","time":{"kind":"event","date":"1959-07","basis":"publication","note":"Date of publication, as the source gives it."},"derivation":"explicit","resolution":"supported","editorialState":"seed","evidenceIds":["evidence-th-ml-samuel-1959-1","evidence-th-ml-samuel-1959-2","evidence-th-ml-samuel-1959-3"],"attributes":{"naming":{"string":"machine learning","sense":"meets","role":"use","register":"nonfiction","reading":"text"}}},{"id":"th-ml-samuel-1959-description","subject":"th-samuel-1959","predicate":"discusses","object":{"kind":"entity","entityId":"th-term-machine-learning"},"topic":"ideas","statement":"Samuel (1959) describes his studies as programming a digital computer to behave in a way that would be described as learning if done by humans or animals, and reports that a checkers program learned to play better than its programmer.","time":{"kind":"event","date":"1959-07","basis":"publication","note":"Date of publication, as the source gives it."},"derivation":"explicit","resolution":"supported","editorialState":"seed","evidenceIds":["evidence-th-ml-samuel-1959-description-1","evidence-th-ml-samuel-1959-description-2"],"attributes":{"technical":{"kind":"definition"}}},{"id":"th-rl-sutton-1988-credits-samuel","subject":"th-sutton-1988","predicate":"credits_work","object":{"kind":"entity","entityId":"th-samuel-1959"},"topic":"ideas","statement":"According to Sutton (1988), temporal-difference methods had been used in Samuel's checker player, Holland's bucket brigade and the author's Adaptive Heuristic Critic.","time":{"kind":"event","date":"1988","basis":"publication","note":"Date of publication, as the source gives it."},"derivation":"explicit","resolution":"supported","editorialState":"seed","evidenceIds":["evidence-th-rl-sutton-1988-credits-samuel-1","evidence-th-rl-sutton-1988-credits-samuel-2"],"attributes":{"attribution":"attributes_term"}},{"id":"th-rl-sb-credits-samuel","subject":"th-sutton-barto-2018","predicate":"credits_work","object":{"kind":"entity","entityId":"th-samuel-1959"},"topic":"ideas","statement":"According to Sutton and Barto (2018), Samuel (1959) proposed and implemented a learning method that included temporal-difference ideas, in his checkers-playing program.","time":{"kind":"event","date":"2018","basis":"publication","note":"Date of publication, as the source gives it."},"derivation":"explicit","resolution":"supported","editorialState":"seed","evidenceIds":["evidence-th-rl-sb-credits-samuel-1","evidence-th-rl-sb-credits-samuel-2"],"attributes":{"attribution":"attributes_term"}}],"sources":[{"id":"source-th-d-samuel-1959","documentId":"th-samuel-1959","title":"Some Studies in Machine Learning Using the Game of Checkers","authors":["Arthur L. Samuel"],"publisher":"IBM Journal of Research and Development (reprint hosted on an MIT CSAIL personal page)","publicationDate":"1959-07","version":"Retrieved for the candidate pack on 2026-10-29 (SHA-256 210a4e8a61eba7ac079a2ac54c2f81009f36310352d0e4f48bbb1d002d54e1cc). Later reprint, numbered 4.3.3 with printed pp. 535–, in an unidentified collection; it states that the paper was originally published in the IBM Journal, vol. 3, no. 3, July 1959. Scanned PDF with an OCR text layer of uneven quality; quotations avoid garbled passages.","evidenceUrl":"https://people.csail.mit.edu/brooks/idocs/Samuel.pdf","language":"en"},{"id":"source-th-d-samuel-1959-crossref","documentId":"th-samuel-1959","title":"Crossref record for DOI 10.1147/rd.33.0210","authors":["A. L. Samuel"],"publisher":"Crossref REST API (bibliographic index; publisher-deposited metadata)","publicationDate":"1959-07","version":"Retrieved for the candidate pack on 2026-10-29 (SHA-256 86bed5363a7b6962abf756e7ad01ce476f2f1c9ee7228f0ffec80ba8fb8cde48). Index record (JSON) for the IBM Journal article","evidenceUrl":"https://api.crossref.org/works/10.1147/rd.33.0210","language":"en"}],"evidence":[{"id":"evidence-th-ml-samuel-1959-1","claimId":"th-ml-samuel-1959","sourceId":"source-th-d-samuel-1959","sourceRole":"primary","support":"supports","verification":"machine_checked","retrievalRoute":"direct"},{"id":"evidence-th-ml-samuel-1959-2","claimId":"th-ml-samuel-1959","sourceId":"source-th-d-samuel-1959","support":"supports","verification":"machine_checked","retrievalRoute":"direct"},{"id":"evidence-th-ml-samuel-1959-3","claimId":"th-ml-samuel-1959","sourceId":"source-th-d-samuel-1959","support":"supports","verification":"machine_checked","retrievalRoute":"direct"},{"id":"evidence-th-ml-samuel-1959-description-1","claimId":"th-ml-samuel-1959-description","sourceId":"source-th-d-samuel-1959","sourceRole":"primary","support":"supports","verification":"machine_checked","retrievalRoute":"direct"},{"id":"evidence-th-ml-samuel-1959-description-2","claimId":"th-ml-samuel-1959-description","sourceId":"source-th-d-samuel-1959","support":"supports","verification":"machine_checked","retrievalRoute":"direct"},{"id":"evidence-th-rl-sutton-1988-credits-samuel-1","claimId":"th-rl-sutton-1988-credits-samuel","sourceId":"source-th-d-sutton-1988","sourceRole":"primary","support":"supports","verification":"machine_checked","retrievalRoute":"direct"},{"id":"evidence-th-rl-sutton-1988-credits-samuel-2","claimId":"th-rl-sutton-1988-credits-samuel","sourceId":"source-th-d-sutton-1988","support":"supports","verification":"machine_checked","retrievalRoute":"direct"},{"id":"evidence-th-rl-sb-credits-samuel-1","claimId":"th-rl-sb-credits-samuel","sourceId":"source-th-d-suttonbarto-2018","sourceRole":"primary","support":"supports","verification":"machine_checked","retrievalRoute":"direct"},{"id":"evidence-th-rl-sb-credits-samuel-2","claimId":"th-rl-sb-credits-samuel","sourceId":"source-th-d-suttonbarto-2018","support":"supports","verification":"machine_checked","retrievalRoute":"direct"}],"at":{"entities":[1572,1617,1627,1658],"claims":[4814,4815,4898,4899],"sources":[1530,1531],"evidence":[6297,6298,6299,6300,6301,6415,6416,6417,6418]},"index":{"byClaim":[],"marks":[],"chronicle":{"years":[{"year":1863,"topics":{"ideas":5},"stated":0},{"year":1865,"topics":{"ideas":1},"stated":0},{"year":1872,"topics":{"ideas":7},"stated":0},{"year":1943,"topics":{"ideas":1},"stated":0},{"year":1947,"topics":{"ideas":2},"stated":0},{"year":1950,"topics":{"ideas":7},"stated":0},{"year":1951,"topics":{"ideas":5},"stated":0},{"year":1952,"topics":{"ideas":2},"stated":0},{"year":1955,"topics":{"ideas":31},"stated":0},{"year":1956,"topics":{"ideas":1},"stated":0},{"year":1957,"topics":{"ideas":1},"stated":0},{"year":1958,"topics":{"ideas":3},"stated":0},{"year":1959,"topics":{"ideas":6},"stated":0},{"year":1960,"topics":{"ideas":11},"stated":0},{"year":1961,"topics":{"ideas":10},"stated":0},{"year":1965,"topics":{"ideas":8},"stated":0},{"year":1966,"topics":{"ideas":20},"stated":0},{"year":1968,"topics":{"ideas":5},"stated":0},{"year":1969,"topics":{"ideas":2},"stated":0},{"year":1971,"topics":{"ideas":4},"stated":0},{"year":1972,"topics":{"ideas":1},"stated":0},{"year":1973,"topics":{"ideas":2},"stated":0},{"year":1974,"topics":{"ideas":2},"stated":0},{"year":1975,"topics":{"ideas":1},"stated":0},{"year":1976,"topics":{"ideas":1},"stated":0},{"year":1977,"topics":{"people":2,"ideas":8},"stated":0},{"year":1979,"topics":{"ideas":4},"stated":0},{"year":1980,"topics":{"ideas":2},"stated":0},{"year":1981,"topics":{"people":2},"stated":0},{"year":1982,"topics":{"ideas":4},"stated":0},{"year":1983,"topics":{"ideas":4},"stated":0},{"year":1984,"topics":{"ideas":21},"stated":0},{"year":1985,"topics":{"ideas":9},"stated":0},{"year":1986,"topics":{"ideas":18},"stated":0},{"year":1987,"topics":{"ideas":1},"stated":0},{"year":1988,"topics":{"ideas":6},"stated":0},{"year":1989,"topics":{"ideas":8},"stated":0},{"year":1990,"topics":{"ideas":5},"stated":0},{"year":1991,"topics":{"ideas":11},"stated":0},{"year":1992,"topics":{"ideas":9},"stated":0},{"year":1993,"topics":{"ideas":14,"people":3},"stated":0},{"year":1994,"topics":{"ideas":14},"stated":0},{"year":1995,"topics":{"ideas":10,"people":1},"stated":0},{"year":1996,"topics":{"ideas":71},"stated":0},{"year":1997,"topics":{"ideas":12},"stated":0},{"year":1998,"topics":{"ideas":49},"stated":0},{"year":1999,"topics":{"ideas":27,"people":1,"institutions":1},"stated":0},{"year":2000,"topics":{"ideas":62},"stated":0},{"year":2001,"topics":{"ideas":39},"stated":0},{"year":2002,"topics":{"ideas":30},"stated":0},{"year":2003,"topics":{"ideas":8},"stated":0},{"year":2004,"topics":{"ideas":12,"people":3},"stated":0},{"year":2005,"topics":{"ideas":10,"people":1},"stated":0},{"year":2006,"topics":{"ideas":26,"people":1},"stated":0},{"year":2007,"topics":{"ideas":20},"stated":0},{"year":2008,"topics":{"ideas":57,"people":3,"institutions":1},"stated":0},{"year":2009,"topics":{"ideas":10,"people":1},"stated":0},{"year":2010,"topics":{"people":3,"ideas":11,"institutions":1,"governance":4},"stated":0},{"year":2011,"topics":{"people":3,"ideas":7,"institutions":2},"stated":0},{"year":2012,"topics":{"people":4,"ideas":17,"institutions":2},"stated":0},{"year":2013,"topics":{"ideas":46,"people":4,"institutions":2,"capital":1},"stated":0},{"year":2014,"topics":{"institutions":2,"ideas":54,"people":5},"stated":0},{"year":2015,"topics":{"people":22,"ideas":122,"institutions":3,"capital":1},"stated":0},{"year":2016,"topics":{"ideas":88,"people":2},"stated":0},{"year":2017,"topics":{"people":16,"institutions":2,"ideas":128,"governance":2},"stated":0},{"year":2018,"topics":{"people":8,"ideas":158,"institutions":8,"governance":1},"stated":0},{"year":2019,"topics":{"capital":1,"compute":1,"people":10,"governance":19,"ideas":175,"institutions":4},"stated":0},{"year":2020,"topics":{"people":6,"ideas":98,"institutions":1,"governance":2},"stated":0},{"year":2021,"topics":{"people":27,"ideas":177,"compute":1,"institutions":23,"governance":4,"capital":6},"stated":0},{"year":2022,"topics":{"people":15,"ideas":217,"institutions":6,"governance":3,"compute":2,"capital":1},"stated":0},{"year":2023,"topics":{"capital":5,"compute":7,"institutions":23,"people":51,"governance":179,"ideas":389},"stated":0},{"year":2024,"topics":{"capital":12,"compute":19,"governance":282,"people":80,"ideas":178,"institutions":28},"stated":1},{"year":2025,"topics":{"governance":547,"compute":69,"capital":34,"people":90,"institutions":18,"ideas":178},"stated":7},{"year":2026,"topics":{"governance":442,"capital":8,"compute":32,"institutions":21,"ideas":91,"people":107},"stated":19},{"year":2027,"topics":{},"stated":9},{"year":2028,"topics":{},"stated":6},{"year":2029,"topics":{},"stated":3},{"year":2030,"topics":{},"stated":3},{"year":2032,"topics":{},"stated":2},{"year":2035,"topics":{},"stated":2},{"year":2039,"topics":{},"stated":1},{"year":2042,"topics":{},"stated":1},{"year":2050,"topics":{},"stated":1}],"scheduled":[],"statedBy":[]},"collections":[{"target":{"kind":"propositions","id":"superintelligence"},"title":"Propositions about superintelligence, 1863–2022","claimIds":[],"records":[]},{"target":{"kind":"propositions","id":"risk-debate"},"title":"Arguments about catastrophic risk from advanced AI","claimIds":[],"records":[]},{"target":{"kind":"propositions","id":"yudkowsky-arguments"},"title":"Eliezer Yudkowsky’s arguments on common claims about AI, 1996–2026","claimIds":[],"records":[]},{"target":{"kind":"propositions","id":"economics-of-machine-intelligence"},"title":"Economics of machine intelligence","claimIds":[],"records":[]},{"target":{"kind":"propositions","id":"orbital-compute-arguments"},"title":"Arguments about compute in orbit","claimIds":[],"records":[]},{"target":{"kind":"propositions","id":"ai-bio-arguments"},"title":"Arguments about AI and biological risk","claimIds":[],"records":[]},{"target":{"kind":"propositions","id":"ai-in-science"},"title":"AI in science","claimIds":[],"records":[]},{"target":{"kind":"documents"},"title":"Frontier safety frameworks","claimIds":[]},{"target":{"kind":"compare","id":"frontier-safety-frameworks"},"title":"Compare frameworks","claimIds":[]},{"target":{"kind":"control","id":"openai"},"title":"OpenAI’s control structure, 2015–2026","claimIds":[]},{"target":{"kind":"control","id":"anthropic"},"title":"Anthropic’s control structure, 2021–2026","claimIds":[]},{"target":{"kind":"commitments"},"title":"External commitments and obligations","claimIds":[]},{"target":{"kind":"question","id":"frameworks-to-obligations"},"title":"Frameworks, commitments and legal obligations, 2023–2026","claimIds":[]},{"target":{"kind":"reading"},"title":"Founding and early leadership","claimIds":[]}]},"version":"131evrz"}