{"entities":[{"id":"eliezer-yudkowsky","name":"Eliezer Yudkowsky","type":"person"},{"id":"levels-of-organization-in-general-intelligence","shortName":"Yudkowsky, Levels of Organization in General Intelligence (2007)","type":"document"},{"id":"lw-2007-the-hidden-complexity-of-wishes","shortName":"Yudkowsky, The Hidden Complexity of Wishes (2007)","type":"document"},{"id":"lw-2007-thou-art-godshatter","shortName":"Yudkowsky, Thou Art Godshatter (2007)","type":"document"},{"id":"lw-2007-the-logical-fallacy-of-generalization-from","shortName":"Yudkowsky, The Logical Fallacy of Generalization from Fictional Evidence (2007)","type":"document"},{"id":"sl4-2007-11-24-yudkowsky-0711-17248","shortName":"Yudkowsky, SL4 message of 2007-11-24 (17248)","type":"document"}],"claims":[{"id":"ts-a2-logi","subject":"levels-of-organization-in-general-intelligence","predicate":"articulates_proposition","object":{"kind":"entity","entityId":"seed-ai"},"topic":"ideas","statement":"Levels of Organization in General Intelligence defines a seed AI as an AI designed for self-understanding, self-modification and recursive self-improvement, and treats recursive self-improvement as a consequence of seed AI rather than a cheap way to achieve AI.","time":{"kind":"event","date":"2007","basis":"publication","note":"Year of the Springer volume, from the reprint’s citation line."},"derivation":"explicit","resolution":"supported","attributes":{"thought":{"roles":["most-developed"],"register":"nonfiction","attested":{"note":"MIRI reprint marked \"This version contains minor changes\"; not compared with the 2007 chapter."}}}},{"id":"ts-a3-logi","subject":"levels-of-organization-in-general-intelligence","predicate":"articulates_proposition","object":{"kind":"entity","entityId":"recursive-self-improvement"},"topic":"ideas","statement":"Levels of Organization in General Intelligence describes recursive self-improvement as a consequence of seed AI.","time":{"kind":"event","date":"2007","basis":"publication","note":"Year of the Springer volume, from the reprint’s citation line."},"derivation":"explicit","resolution":"supported","attributes":{"thought":{"roles":["articulation"],"register":"nonfiction","attested":{"note":"MIRI reprint marked \"This version contains minor changes\"; not compared with the 2007 chapter."}}}},{"id":"yk-y03-lw-2007-the-hidden-complexity-of-wishes-c","subject":"lw-2007-the-hidden-complexity-of-wishes","predicate":"contests_proposition","object":{"kind":"entity","entityId":"understanding-implies-compliance"},"topic":"ideas","statement":"The post “The Hidden Complexity of Wishes” (2007-11-24) contests Y03. Correcting a reading of his 2007 post, he says the difficulty he described concerns what a superintelligence wants, not whether it could understand or predict human values.","time":{"kind":"event","date":"2007-11-24","basis":"publication","note":"LessWrong postedAt of an imported Overcoming Bias post (Overcoming Bias date)."},"derivation":"explicit","resolution":"supported","attributes":{"thought":{"roles":["contesting","later-restatement"],"register":"nonfiction","attested":{"date":"2024-05","note":"Note signed 'EY, May 2024'; absent from the posting-day version 1.0.0 of the 2007 post."},"engagement":{"kind":"engages-premise","rationale":"Under the message-level rule, the passage, read with the paragraph, message or dialogue turn it belongs to, gives a reason against the premise that if an AI understands what we intend, it will act on that understanding."}}}},{"id":"yk-y04-lw-2007-the-hidden-complexity-of-wishes-c","subject":"lw-2007-the-hidden-complexity-of-wishes","predicate":"contests_proposition","object":{"kind":"entity","entityId":"short-instruction-suffices"},"topic":"ideas","statement":"The post “The Hidden Complexity of Wishes” (2007-11-24) contests Y04. Using an Outcome Pump that rescues a mother from a burning building by exploding it, he argues that any short wish leaves out values a powerful optimizer will trample.","time":{"kind":"event","date":"2007-11-24","basis":"publication","note":"LessWrong postedAt of an imported Overcoming Bias post (Overcoming Bias date)."},"derivation":"explicit","resolution":"supported","attributes":{"thought":{"roles":["contesting"],"register":"nonfiction","engagement":{"kind":"engages-premise","rationale":"Under the message-level rule, the passage, read with the paragraph, message or dialogue turn it belongs to, gives a reason against the premise that a short instruction such as 'make people happy' specifies what we want."}}}},{"id":"yk-y05-lw-2007-thou-art-godshatter-b","subject":"lw-2007-thou-art-godshatter","predicate":"bears_on_proposition","object":{"kind":"entity","entityId":"feedback-instils-values"},"topic":"ideas","statement":"The post “Thou Art Godshatter” (2007-11-13) bears on Y05. Discussing human evolution, he observes that selection for reproductive fitness produced many separate desires rather than a desire for fitness itself; he later applies the analogy to AI training (AGI Ruin item 16).","time":{"kind":"event","date":"2007-11-13","basis":"publication","note":"LessWrong postedAt of an imported Overcoming Bias post (Overcoming Bias date)."},"derivation":"explicit","resolution":"supported","attributes":{"thought":{"roles":["context"],"register":"nonfiction","missing":"About evolution and human desires, not about training AI on human feedback."}}},{"id":"yk-y20-lw-2007-the-logical-fallacy-of-generalization-from-c","subject":"lw-2007-the-logical-fallacy-of-generalization-from","predicate":"contests_proposition","object":{"kind":"entity","entityId":"risk-is-film-fiction"},"topic":"ideas","statement":"The post “The Logical Fallacy of Generalization from Fictional Evidence” (2007-10-16) contests Y20. Responding to people who answer talk of advanced AI with film references, he argues that starting from fiction frames the debate around an 'Us vs. Them' struggle and leaves out the scenarios he considers relevant.","time":{"kind":"event","date":"2007-10-16","basis":"publication","note":"LessWrong postedAt of an imported Overcoming Bias post (Overcoming Bias date)."},"derivation":"explicit","resolution":"supported","attributes":{"thought":{"roles":["contesting"],"register":"nonfiction","engagement":{"kind":"engages-premise","rationale":"Under the message-level rule, the passage, read with the paragraph, message or dialogue turn it belongs to, gives a reason against the premise that film scenarios are a fair guide to what the risk would look like."}}}},{"id":"yk-y24-sl4-2007-11-24-yudkowsky-0711-17248-c","subject":"sl4-2007-11-24-yudkowsky-0711-17248","predicate":"contests_proposition","object":{"kind":"entity","entityId":"build-it-before-rivals"},"topic":"ideas","statement":"The SL4 message “Re: UCaRtMaAI paper” (2007-11-24) contests Y24. Replying to Tim Freeman, who argued against waiting until we know what we are doing because other AGI projects are proceeding without concern for Friendliness, he says that doing better than competitors does not count.","time":{"kind":"event","date":"2007-11-24","basis":"publication","note":"Archive author index lists the message as \"Sat Nov 24 2007 - 17:36:29 MST\" under \"Eliezer S. Yudkowsky\"."},"derivation":"explicit","resolution":"supported","attributes":{"thought":{"roles":["contesting","earliest-located"],"register":"nonfiction","engagement":{"kind":"engages-premise","rationale":"Under the message-level rule, the passage, read with the paragraph, message or dialogue turn it belongs to, gives a reason against the premise that racing to be first improves the outcome."}}}},{"id":"ap-eliezer-yudkowsky-levels-of-organization-in-general-intelligence","subject":"eliezer-yudkowsky","predicate":"authored","object":{"kind":"entity","entityId":"levels-of-organization-in-general-intelligence"},"topic":"ideas","statement":"“Levels of Organization in General Intelligence” (2007) credits Eliezer Yudkowsky as its author.","time":{"kind":"event","date":"2007","basis":"publication","note":"Date the source record gives for this text; authorship is credited in the inspected expression."},"derivation":"explicit","resolution":"supported"},{"id":"ap-eliezer-yudkowsky-lw-2007-the-logical-fallacy-of-generalization-from","subject":"eliezer-yudkowsky","predicate":"authored","object":{"kind":"entity","entityId":"lw-2007-the-logical-fallacy-of-generalization-from"},"topic":"ideas","statement":"“The Logical Fallacy of Generalization from Fictional Evidence” (2007-10-16) credits Eliezer Yudkowsky as its author.","time":{"kind":"event","date":"2007-10-16","basis":"publication","note":"Date the source record gives for this text; authorship is credited in the inspected expression."},"derivation":"explicit","resolution":"supported"},{"id":"ap-eliezer-yudkowsky-lw-2007-thou-art-godshatter","subject":"eliezer-yudkowsky","predicate":"authored","object":{"kind":"entity","entityId":"lw-2007-thou-art-godshatter"},"topic":"ideas","statement":"“Thou Art Godshatter” (2007-11-13) credits Eliezer Yudkowsky as its author.","time":{"kind":"event","date":"2007-11-13","basis":"publication","note":"Date the source record gives for this text; authorship is credited in the inspected expression."},"derivation":"explicit","resolution":"supported"},{"id":"ap-eliezer-yudkowsky-lw-2007-the-hidden-complexity-of-wishes","subject":"eliezer-yudkowsky","predicate":"authored","object":{"kind":"entity","entityId":"lw-2007-the-hidden-complexity-of-wishes"},"topic":"ideas","statement":"“The Hidden Complexity of Wishes” (2007-11-24) credits Eliezer Yudkowsky as its author.","time":{"kind":"event","date":"2007-11-24","basis":"publication","note":"Date the source record gives for this text; authorship is credited in the inspected expression."},"derivation":"explicit","resolution":"supported"},{"id":"ap-eliezer-yudkowsky-sl4-2007-11-24-yudkowsky-0711-17248","subject":"eliezer-yudkowsky","predicate":"authored","object":{"kind":"entity","entityId":"sl4-2007-11-24-yudkowsky-0711-17248"},"topic":"ideas","statement":"The mailing-list message “Re: UCaRtMaAI paper” (2007-11-24) is sent under the name Eliezer S. Yudkowsky.","time":{"kind":"event","date":"2007-11-24","basis":"publication","note":"Date the source record gives for this text; authorship is credited in the inspected expression."},"derivation":"explicit","resolution":"supported"}],"sources":[],"evidence":[],"at":{"entities":[19,315,412,429,437,488],"claims":[923,924,1007,1012,1021,1122,1149,2430,2431,2432,2433,2434],"sources":[],"evidence":[]},"version":"1lg47t7"}