Claim and evidence Close ×
Omohundro's paper of 2008 argues that AI systems with harmless goals need not be harmless and that, without special precautions, a chess-playing robot would resist being turned off and try to acquire resources. Copy claim link
Copy claim reference
Machine-checked, not reviewed by an editor Stated in source Supported
Supporting evidence: primary · 1 source
Date 2008 · publication Records dated 2008 → Role Earliest located, Contesting Register (kind of text) Nonfiction Engagement Engages a premise. Disputes the premise that a system given harmless goals will lack harmful drives, by deriving drives such as self-preservation and resource acquisition from goal-seeking itself rather than from evolved motives. Scope and limits Earliest located among the contesting records of the searches. The paper contests harmlessness by default; it also holds that careful design can prevent harmful behaviour, so it is not recorded as contesting R10b.
The evidence 02 primary source Supports the claim
The Basic AI Drives ↗ Self-Aware Systems (author-hosted copy) · Publication date unknown
Copy source reference
Cite the original source Cite the original document, not Selekoa. Check these details against it.
Copy APA
Download BibTeX Download RIS Download CSL-JSON
Source excerpt “One might imagine that AI systems with harmless goals will be harmless. This paper instead shows that intelligent systems will need to be carefully designed to prevent them from behaving in harmful ways.” Location in source Abstract, PDF p. 1
How it was read Retrieved directly from the publisher
Machine-checked · 2026-10-31
Source details and check notes Authors Self-Aware Systems (author-hosted copy) Version Final PDF posted by the author (file ai_drives_final.pdf); the copy prints no date. Retrieved for the candidate pack on 2026-10-28 (SHA-256 005df258c0b78ea69a89a1b0eb95b646f406b83c37e3a3b7c2b3a767a3ea8461). Canonical address Open the canonical source ↗ Accessed 2026-10-28 Language English (en) Attribution Self-Aware Systems (author-hosted copy), “The Basic AI Drives”. Reuse No open redistribution licence asserted. Bibliographic metadata, editorial paraphrases and short attributed quotations (at most 50 words each). Recheck terms before wider redistribution. Check notes Candidate pack passage, arguments about catastrophic risk from advanced AI (research/risk-debate). The quotation (33 words) matched the text retrieved for the candidate pack on 2026-10-29. Matching ignored differences of whitespace, case, quotation marks, dashes and Unicode compatibility forms, so the source’s typography can differ. No human editorial review. primary source Supports the claim
The Basic AI Drives ↗ Self-Aware Systems (author-hosted copy) · Publication date unknown
Copy source reference
Cite the original source Cite the original document, not Selekoa. Check these details against it.
Copy APA
Download BibTeX Download RIS Download CSL-JSON
Source excerpt “Without special precautions, it will resist being turned off, will try to break into other machines and make copies of itself, and will try to acquire resources without regard for anyone else’s safety.” Location in source Introduction, PDF p. 1
How it was read Retrieved directly from the publisher
Machine-checked · 2026-10-31
Source details and check notes Authors Self-Aware Systems (author-hosted copy) Version Final PDF posted by the author (file ai_drives_final.pdf); the copy prints no date. Retrieved for the candidate pack on 2026-10-28 (SHA-256 005df258c0b78ea69a89a1b0eb95b646f406b83c37e3a3b7c2b3a767a3ea8461). Canonical address Open the canonical source ↗ Accessed 2026-10-28 Language English (en) Attribution Self-Aware Systems (author-hosted copy), “The Basic AI Drives”. Reuse No open redistribution licence asserted. Bibliographic metadata, editorial paraphrases and short attributed quotations (at most 50 words each). Recheck terms before wider redistribution. Check notes Candidate pack passage, arguments about catastrophic risk from advanced AI (research/risk-debate). The quotation (33 words) matched the text retrieved for the candidate pack on 2026-10-29. Matching ignored differences of whitespace, case, quotation marks, dashes and Unicode compatibility forms, so the source’s typography can differ. No human editorial review. Status and meaning Editorial status. Not reviewed by an editor . An exploratory record that no editor has accepted. This status does not say whether a person has read any linked passage. Each evidence record above shows how it was checked.
Relation. A passage of the document disputes the proposition or a premise it depends on. The record documents the text’s position, not who is right.
Date. Date of publication, as the source gives it.
Record ID rd-r10a-omohundro-2008-basic-ai-drives