We need to get it right, and to get it right, we need a community of people engaging with each other, discussing, criticizing. There's no point talking about whether what SIAI is striving for would be preferable; SIAI is not going to get it right on their own. Your only choices are
1. More open discussion involving hundreds or thousands of people, leading to an understanding of the problem, leading to somebody, somewhere, having a chance of getting it right, or
2. No open discussion, SIAI gets it wrong and either produces no AI, or an AI that does horrible things, or
![[personal profile]](https://www.dreamwidth.org/img/silk/identity/user.png){kind=small}
Re: obviousness of possible failure modes
Date: 2010-05-18 02:49 pm (UTC)1. More open discussion involving hundreds or thousands of people, leading to an understanding of the problem, leading to somebody, somewhere, having a chance of getting it right, or
2. No open discussion, SIAI gets it wrong and either produces no AI, or an AI that does horrible things, or
3. No discussion, skynet.