{"entities":[{"id":"aib-doc-casp14-assessment-2021","name":"Critical Assessment of Methods of Protein Structure Prediction (CASP) – Round XIV","type":"document","subtype":"Journal article","description":"Proteins 89(12), 1607–1617, 7 October 2021 (NIH author manuscript consulted). Publication date and issue month from the PMC author-manuscript header (\"Proteins. 2021 Oct 7;89(12):1607–1617\"; \"Issue date 2021 Dec\"). Submission and acceptance dates are not stated there. PMC's \"Published in final edited form\" line does not state the kind of the day date. The paper is the CASP organisers' overview of the round.","sourceIds":["source-aib-casp14-assessment"]}],"claims":[{"id":"aib-mod-casp14-folding-problem-wording","subject":"aib-doc-casp14-assessment-2021","predicate":"states_provision","object":{"kind":"literal","value":"The CASP14 organisers' own characterisation of what the results represent"},"topic":"ideas","statement":"Kryshtafovych et al. (Proteins, 7 October 2021) write that in this sense the results of CASP14 represent a solution to the classical protein folding problem, at least for single proteins.","time":{"kind":"event","date":"2021-10-07","basis":"publication","note":"Date given in PMC's \"Published in final edited form\" line for the organisers' overview paper (kind not stated)."},"resolution":"supported","evidenceIds":["evidence-aib-mod-casp14-folding-problem-wording-1"],"attributes":{"provision":{"kind":"statement","key":"mod-casp14-folding-problem-wording"}}},{"id":"aib-mod-casp14-gdt-two-thirds","subject":"aib-doc-casp14-assessment-2021","predicate":"states_provision","object":{"kind":"literal","value":"CASP14: about two thirds of 96 targets considered competitive with experiment in backbone accuracy"},"topic":"ideas","statement":"Kryshtafovych et al. (Proteins, 7 October 2021) state that in CASP14 about two thirds of the 96 targets reached GDT_TS values above about 90, which they describe as approximately the limit expected given experimental error, and so are considered competitive with experiment in backbone accuracy.","time":{"kind":"event","date":"2021-10-07","basis":"publication","note":"Date given in PMC's \"Published in final edited form\" line for the organisers' overview paper (kind not stated)."},"resolution":"supported","evidenceIds":["evidence-aib-mod-casp14-gdt-two-thirds-1","evidence-aib-mod-casp14-gdt-two-thirds-2"],"attributes":{"provision":{"kind":"statement","key":"mod-casp14-gdt-two-thirds"}}},{"id":"aib-mod-casp14-one-group","subject":"aib-doc-casp14-assessment-2021","predicate":"states_provision","object":{"kind":"literal","value":"CASP14: deep learning methods from one research group delivered structures rivalling experimental ones, as the organisers state"},"topic":"ideas","statement":"Kryshtafovych et al. (Proteins, 7 October 2021) state that in CASP14 deep learning methods from one research group consistently delivered computed structures rivalling the corresponding experimental ones in accuracy.","time":{"kind":"event","date":"2021-10-07","basis":"publication","note":"Date given in PMC's \"Published in final edited form\" line for the organisers' overview paper (kind not stated)."},"resolution":"supported","evidenceIds":["evidence-aib-mod-casp14-one-group-1"],"attributes":{"provision":{"kind":"statement","key":"mod-casp14-one-group"}}},{"id":"aib-mod-casp14-other-groups","subject":"aib-doc-casp14-assessment-2021","predicate":"states_provision","object":{"kind":"literal","value":"CASP14: other groups also advanced, and AlphaFold2 did not submit server models"},"topic":"ideas","statement":"Kryshtafovych et al. (Proteins, 7 October 2021) state that although the CASP14 performance is dominated by AlphaFold2, other groups also advanced substantially from CASP13, and that AlphaFold2 did not submit server models.","time":{"kind":"event","date":"2021-10-07","basis":"publication","note":"Date given in PMC's \"Published in final edited form\" line for the organisers' overview paper (kind not stated)."},"resolution":"supported","evidenceIds":["evidence-aib-mod-casp14-other-groups-1","evidence-aib-mod-casp14-other-groups-2"],"attributes":{"provision":{"kind":"statement","key":"mod-casp14-other-groups"}}},{"id":"aib-mod-casp14-participation","subject":"aib-doc-casp14-assessment-2021","predicate":"states_provision","object":{"kind":"literal","value":"CASP14 participation and target numbers as stated by the organisers"},"topic":"ideas","statement":"Kryshtafovych et al. (Proteins, 7 October 2021) state that CASP14 participants tested 215 modeling methods and submitted over 67,000 predictions in six prediction categories, and that structures of 52 proteins and protein–protein complexes were received from the experimental community in time for the assessments.","time":{"kind":"event","date":"2021-10-07","basis":"publication","note":"Date given in PMC's \"Published in final edited form\" line for the organisers' overview paper (kind not stated)."},"resolution":"supported","evidenceIds":["evidence-aib-mod-casp14-participation-1","evidence-aib-mod-casp14-participation-2"],"attributes":{"provision":{"kind":"statement","key":"mod-casp14-participation"}}},{"id":"aib-mod-casp14-what-casp-is","subject":"aib-doc-casp14-assessment-2021","predicate":"states_provision","object":{"kind":"literal","value":"CASP described by its organisers as a community experiment with blind testing and independent assessors"},"topic":"ideas","statement":"Kryshtafovych et al. (Proteins, 7 October 2021) state that CASP is a community experiment to advance methods of computing three-dimensional protein structure from amino acid sequence, whose core components are rigorous blind testing of methods and evaluation of the results by independent assessors.","time":{"kind":"event","date":"2021-10-07","basis":"publication","note":"Date given in PMC's \"Published in final edited form\" line for the organisers' overview paper (kind not stated)."},"resolution":"supported","evidenceIds":["evidence-aib-mod-casp14-what-casp-is-1"],"attributes":{"provision":{"kind":"statement","key":"mod-casp14-what-casp-is"}}}],"sources":[{"id":"source-aib-casp14-assessment","documentId":"aib-doc-casp14-assessment-2021","title":"Critical Assessment of Methods of Protein Structure Prediction (CASP) – Round XIV","authors":["Andriy Kryshtafovych","Torsten Schwede","Maya Topf","Krzysztof Fidelis","John Moult"],"publisher":"Proteins: Structure, Function, and Bioinformatics (author manuscript in PubMed Central)","publicationDate":"2021-10-07","version":"Retrieved for the candidate pack on 2026-10-30 (SHA-256 df99b254a35a7840ddee25447610b25ab4a93154355ed2a0ec6db9b25d10710d). NIH author manuscript (PMC8726744) of Proteins 89(12):1607–1617; the publisher version of record was not retrieved.","evidenceUrl":"https://pmc.ncbi.nlm.nih.gov/articles/PMC8726744/","language":"en"}],"evidence":[{"id":"evidence-aib-mod-casp14-folding-problem-wording-1","claimId":"aib-mod-casp14-folding-problem-wording","sourceId":"source-aib-casp14-assessment","support":"supports","locator":"abstract","passage":"In this sense, the results represent a solution to the classical protein folding problem, at least for single proteins.","passageType":"quote"},{"id":"evidence-aib-mod-casp14-gdt-two-thirds-1","claimId":"aib-mod-casp14-gdt-two-thirds","sourceId":"source-aib-casp14-assessment","support":"supports","locator":"section \"Three-dimensional Protein Structure Modeling\" (PMC author manuscript)","passage":"In CASP14, about 2/3 of the 96 targets reached GDT_TS values greater than that, and so are considered competitive with experiment in backbone accuracy.","passageType":"quote"},{"id":"evidence-aib-mod-casp14-one-group-1","claimId":"aib-mod-casp14-one-group","sourceId":"source-aib-casp14-assessment","support":"supports","locator":"abstract","passage":"In the most recent experiment (CASP14) deep learning methods from one research group consistently delivered computed structures rivalling the corresponding experimental ones in accuracy.","passageType":"quote"},{"id":"evidence-aib-mod-casp14-other-groups-1","claimId":"aib-mod-casp14-other-groups","sourceId":"source-aib-casp14-assessment","support":"supports","locator":"section on three-dimensional protein structure modeling","passage":"Although this outstanding performance is dominated by AlphaFold2 (group 427), the dashed black line in Figure 1 shows that other groups also advanced substantially from CASP13.","passageType":"quote"},{"id":"evidence-aib-mod-casp14-participation-1","claimId":"aib-mod-casp14-participation","sourceId":"source-aib-casp14-assessment","support":"supports","locator":"introductory section on CASP14 participation","passage":"tested 215 modeling methods and submitted over 67,000 predictions in six prediction categories","passageType":"quote"},{"id":"evidence-aib-mod-casp14-what-casp-is-1","claimId":"aib-mod-casp14-what-casp-is","sourceId":"source-aib-casp14-assessment","support":"supports","locator":"abstract","passage":"CASP is a community experiment to advance methods of computing three-dimensional protein structure from amino acid sequence. Core components are rigorous blind testing of methods and evaluation of the results by independent assessors.","passageType":"quote"}],"at":{"entities":[1337],"claims":[3611,3612,3613,3614,3615,3616],"sources":[1181],"evidence":[4992,4993,4995,4996,4998,5000]},"index":{"byClaim":[],"marks":[],"chronicle":{"years":[{"year":1863,"topics":{"ideas":5},"stated":0},{"year":1865,"topics":{"ideas":1},"stated":0},{"year":1872,"topics":{"ideas":7},"stated":0},{"year":1943,"topics":{"ideas":1},"stated":0},{"year":1947,"topics":{"ideas":2},"stated":0},{"year":1950,"topics":{"ideas":7},"stated":0},{"year":1951,"topics":{"ideas":5},"stated":0},{"year":1952,"topics":{"ideas":2},"stated":0},{"year":1955,"topics":{"ideas":31},"stated":0},{"year":1956,"topics":{"ideas":1},"stated":0},{"year":1957,"topics":{"ideas":1},"stated":0},{"year":1958,"topics":{"ideas":3},"stated":0},{"year":1959,"topics":{"ideas":6},"stated":0},{"year":1960,"topics":{"ideas":11},"stated":0},{"year":1961,"topics":{"ideas":10},"stated":0},{"year":1965,"topics":{"ideas":8},"stated":0},{"year":1966,"topics":{"ideas":20},"stated":0},{"year":1968,"topics":{"ideas":5},"stated":0},{"year":1969,"topics":{"ideas":2},"stated":0},{"year":1971,"topics":{"ideas":4},"stated":0},{"year":1972,"topics":{"ideas":1},"stated":0},{"year":1973,"topics":{"ideas":2},"stated":0},{"year":1974,"topics":{"ideas":2},"stated":0},{"year":1975,"topics":{"ideas":1},"stated":0},{"year":1976,"topics":{"ideas":1},"stated":0},{"year":1977,"topics":{"people":2,"ideas":8},"stated":0},{"year":1979,"topics":{"ideas":4},"stated":0},{"year":1980,"topics":{"ideas":2},"stated":0},{"year":1981,"topics":{"people":2},"stated":0},{"year":1982,"topics":{"ideas":4},"stated":0},{"year":1983,"topics":{"ideas":4},"stated":0},{"year":1984,"topics":{"ideas":21},"stated":0},{"year":1985,"topics":{"ideas":9},"stated":0},{"year":1986,"topics":{"ideas":18},"stated":0},{"year":1987,"topics":{"ideas":1},"stated":0},{"year":1988,"topics":{"ideas":6},"stated":0},{"year":1989,"topics":{"ideas":8},"stated":0},{"year":1990,"topics":{"ideas":5},"stated":0},{"year":1991,"topics":{"ideas":11},"stated":0},{"year":1992,"topics":{"ideas":9},"stated":0},{"year":1993,"topics":{"ideas":14,"people":3},"stated":0},{"year":1994,"topics":{"ideas":14},"stated":0},{"year":1995,"topics":{"ideas":10,"people":1},"stated":0},{"year":1996,"topics":{"ideas":71},"stated":0},{"year":1997,"topics":{"ideas":12},"stated":0},{"year":1998,"topics":{"ideas":49},"stated":0},{"year":1999,"topics":{"ideas":27,"people":1,"institutions":1},"stated":0},{"year":2000,"topics":{"ideas":62},"stated":0},{"year":2001,"topics":{"ideas":39},"stated":0},{"year":2002,"topics":{"ideas":30},"stated":0},{"year":2003,"topics":{"ideas":8},"stated":0},{"year":2004,"topics":{"ideas":12,"people":3},"stated":0},{"year":2005,"topics":{"ideas":10,"people":1},"stated":0},{"year":2006,"topics":{"ideas":26,"people":1},"stated":0},{"year":2007,"topics":{"ideas":20},"stated":0},{"year":2008,"topics":{"ideas":57,"people":3,"institutions":1},"stated":0},{"year":2009,"topics":{"ideas":10,"people":1},"stated":0},{"year":2010,"topics":{"people":3,"ideas":11,"institutions":1,"governance":4},"stated":0},{"year":2011,"topics":{"people":3,"ideas":7,"institutions":2},"stated":0},{"year":2012,"topics":{"people":4,"ideas":17,"institutions":2},"stated":0},{"year":2013,"topics":{"ideas":46,"people":4,"institutions":2,"capital":1},"stated":0},{"year":2014,"topics":{"institutions":2,"ideas":54,"people":5},"stated":0},{"year":2015,"topics":{"people":22,"ideas":122,"institutions":3,"capital":1},"stated":0},{"year":2016,"topics":{"ideas":88,"people":2},"stated":0},{"year":2017,"topics":{"people":16,"institutions":2,"ideas":128,"governance":2},"stated":0},{"year":2018,"topics":{"people":8,"ideas":158,"institutions":8,"governance":1},"stated":0},{"year":2019,"topics":{"capital":1,"compute":1,"people":10,"governance":19,"ideas":175,"institutions":4},"stated":0},{"year":2020,"topics":{"people":6,"ideas":98,"institutions":1,"governance":2},"stated":0},{"year":2021,"topics":{"people":27,"ideas":177,"compute":1,"institutions":23,"governance":4,"capital":6},"stated":0},{"year":2022,"topics":{"people":15,"ideas":217,"institutions":6,"governance":3,"compute":2,"capital":1},"stated":0},{"year":2023,"topics":{"capital":5,"compute":7,"institutions":23,"people":51,"governance":179,"ideas":389},"stated":0},{"year":2024,"topics":{"capital":12,"compute":19,"governance":282,"people":80,"ideas":178,"institutions":28},"stated":1},{"year":2025,"topics":{"governance":547,"compute":69,"capital":34,"people":90,"institutions":18,"ideas":178},"stated":7},{"year":2026,"topics":{"governance":442,"capital":8,"compute":32,"institutions":21,"ideas":91,"people":107},"stated":19},{"year":2027,"topics":{},"stated":9},{"year":2028,"topics":{},"stated":6},{"year":2029,"topics":{},"stated":3},{"year":2030,"topics":{},"stated":3},{"year":2032,"topics":{},"stated":2},{"year":2035,"topics":{},"stated":2},{"year":2039,"topics":{},"stated":1},{"year":2042,"topics":{},"stated":1},{"year":2050,"topics":{},"stated":1}],"scheduled":[],"statedBy":[]},"collections":[{"target":{"kind":"propositions","id":"superintelligence"},"title":"Propositions about superintelligence, 1863–2022","claimIds":[],"records":[]},{"target":{"kind":"propositions","id":"risk-debate"},"title":"Arguments about catastrophic risk from advanced AI","claimIds":[],"records":[]},{"target":{"kind":"propositions","id":"yudkowsky-arguments"},"title":"Eliezer Yudkowsky’s arguments on common claims about AI, 1996–2026","claimIds":[],"records":[]},{"target":{"kind":"propositions","id":"economics-of-machine-intelligence"},"title":"Economics of machine intelligence","claimIds":[],"records":[]},{"target":{"kind":"propositions","id":"orbital-compute-arguments"},"title":"Arguments about compute in orbit","claimIds":[],"records":[]},{"target":{"kind":"propositions","id":"ai-bio-arguments"},"title":"Arguments about AI and biological risk","claimIds":[],"records":[]},{"target":{"kind":"propositions","id":"ai-in-science"},"title":"AI in science","claimIds":[],"records":[]},{"target":{"kind":"documents"},"title":"Frontier safety frameworks","claimIds":[]},{"target":{"kind":"compare","id":"frontier-safety-frameworks"},"title":"Compare frameworks","claimIds":[]},{"target":{"kind":"control","id":"openai"},"title":"OpenAI’s control structure, 2015–2026","claimIds":[]},{"target":{"kind":"control","id":"anthropic"},"title":"Anthropic’s control structure, 2021–2026","claimIds":[]},{"target":{"kind":"commitments"},"title":"External commitments and obligations","claimIds":[]},{"target":{"kind":"question","id":"frameworks-to-obligations"},"title":"Frameworks, commitments and legal obligations, 2023–2026","claimIds":[]},{"target":{"kind":"reading"},"title":"Founding and early leadership","claimIds":[]}]},"version":"131evrz"}