Value drift is a form of being wiped out, a slow and non-obvious one. It should be seen as an existential threat, not a technology to be embraced (and I don't need to explain here how some advanced technologies offer similar seduction, wanted and liked, but potentially harmful beyond reason). Which preference do you think the IA-affected people will prefer to instantiate in the FAI? It might be in the interest of present humanity to avoid involving IA-affected people in FAI research, to the extent it will be possible.
That something is inevitable is not a moral argument for it being good, and I'm arguing specifically that it's not a good idea to use mind modification on the path to FAI.
![[personal profile]](https://www.dreamwidth.org/img/silk/identity/user.png){kind=small}
Re: intelligence augmentation
Date: 2010-04-17 08:52 pm (UTC)That something is inevitable is not a moral argument for it being good, and I'm arguing specifically that it's not a good idea to use mind modification on the path to FAI.