advancedresearch / ethicophysics

various mathematical properties arising from the exercise of free will by the human animal
Apache License 2.0
8 stars 1 forks source link

On slave minds #21

Closed epurdyf closed 2 years ago

epurdyf commented 6 years ago

Note that a truly evil superintelligence can amplify its powers by imprisoning mind slaves in a hostile simulation. There is no real defense against this as a means of amplifying intelligence... but it may not matter in the final analysis.

Presumably there is some sort of lesson about design patterns to avoid when designing superintelligences that are intended to be friendly.