Stuart Russell's comments in the Facebook thread on instrumental convergence (2019)
A comment by Stuart Russell, dated 4 October 2019. Known from the LessWrong copy of 4 October 2019; the comments themselves are undated.
- Issued by
- No issuing record yet. A missing record is a gap in coverage.
- Authors credited
- No authorship claim recorded yet. A missing record is a gap in coverage.
- Dates
- No date claim recorded yet. A missing record is a gap in coverage.
- Exact source
- no source record matches this exact version of the document. Sources for the description: Debate on Instrumental Convergence between LeCun, Russell, Bengio, Zador, and More
Appears in
- Arguments about catastrophic risk from advanced AI →2 records on this document
Versions
No other versions of this document are recorded. The evidence applies to the source version listed above. Other versions, such as a preprint, working paper or journal publication, are not identified or substituted.
Documentary relations
Each relation is listed separately. Citing, crediting and reporting the use of a method are different acts, and none of them shows agreement or influence by itself.
Cites · 1
Explicit references in this document. Citation is neither agreement nor influence.
- Anthony Zador's comments in the Facebook thread on instrumental convergence (2019)Russell's comment in the 2019 thread replies to Zador's.2019-10-04 · publication · Stated in source · Supported Inspect claim & evidence ↗Zador, comments in the Facebook thread on instrumental convergence (2019): document page →
Cited by · 2
Recorded documents that explicitly reference this one. A citation to a work does not identify which version was read.
- Yann LeCun's comments in the Facebook thread on instrumental convergence (2019)LeCun's comment in the 2019 thread replies to Russell's coffee-fetching argument, which Bengio had asked him to answer.2019-10-04 · publication · Stated in source · Supported Inspect claim & evidence ↗LeCun, comments in the Facebook thread on instrumental convergence (2019): document page →
- Anthony Zador's comments in the Facebook thread on instrumental convergence (2019)Zador's comment in the 2019 thread replies to Russell's argument, naming him.2019-10-04 · publication · Stated in source · Supported Inspect claim & evidence ↗Zador, comments in the Facebook thread on instrumental convergence (2019): document page →
Articulates · 2
Propositions whose criterion a passage of this document meets. The record says what the text states, in its register; it is not evidence that the proposition is true.
- Instrumental convergenceRussell's comment in the 2019 thread states that in a toy decision problem an agent rewarded only for fetching coffee would switch off a human who might switch it off, with no built-in survival instinct or desire for power.2019-10-04 · publication · Stated in source · Supported Inspect claim & evidence ↗Instrumental convergence: propositions page →
- Difficulty of alignmentRussell's comment in the 2019 thread states that machines are already built on the assumption of a fixed, known objective, that this becomes more untenable as they become more powerful, and that there is no hope of solving value alignment by specifying the right value function offline.2019-10-04 · publication · Stated in source · Supported Inspect claim & evidence ↗Difficulty of alignment: propositions page →
Not recorded for this document: explicitly credits · reports using a method from · method reported as used by · applies parts of · parts applied by · discusses · reports evaluation of. A missing record does not show that the relation does not exist.