Mind Crime occurs when a computational process which has moral value is mistreated. For example, an advanced AI trying to predict human behavior might create simulations of humans so detailed as to be conscious observers, which would then suffer through whatever hypothetical scenarios the AI wanted to test and then be discarded.
Mind crime on a large scale constitutes a risk of astronomical suffering.
Mind crime is different from other AI risks in that the AI need not even affect anything an agent can do justoutside its box for the catastrophe to occur.
The term was coined by using its own computational resources that is morally wrong. The most commonly used example is an AI creatingNick Bostrom in Superintelligence: Paths, Dangers, Strategies.
Not the same as thoughtcrime, a conscious simulation of a human being tortured.term for having beliefs considered unacceptable by society.
See also: Risks of Astronomical Suffering
See also: Risks of Astronomical Suffering
Mind CrimeMindcrime occurs when a computational process which has moral value is mistreated. For example, an advanced AI trying to predict human behavior might create simulations of humans so detailed as to be conscious observers, which would then suffer through whatever hypothetical scenarios the AI wanted to test and then be discarded.Mind crimeMindcrime on a large scale constitutes a risk of astronomical suffering.Mind crimeMindcrime is different from other AI risks in that the AI need not even affect anything outside its box for the catastrophe to occur.