Oh, I certainly understand the idea of fixed preference (or at least I think I do, and yes, I've read the current sequence in your blog). What I'm saying is that I don't have fixed preferences outside a very narrow set. I would certainly be very cautious about using any IA that would threaten to change the preferences falling into that set.
Though I feel this discussion is getting rather abstract. Of course we should consider the pros and cons of each individual IA technique as they come along. But I don't think saying "we shouldn't use IA because it might change some of our values" is very useful when we don't know what realistic IA techniques might actually be and how they work. Certainly none of the techniques that are currently available, or of the ones that will be available in say 15 years, will be in the category of being able to radically change our values.
Re: intelligence augmentation
Date: 2010-04-17 09:48 pm (UTC)Though I feel this discussion is getting rather abstract. Of course we should consider the pros and cons of each individual IA technique as they come along. But I don't think saying "we shouldn't use IA because it might change some of our values" is very useful when we don't know what realistic IA techniques might actually be and how they work. Certainly none of the techniques that are currently available, or of the ones that will be available in say 15 years, will be in the category of being able to radically change our values.