Once we have something that is no longer under control, once technological development is yanked out of our hands, it doesn't have to continue to be beneficial to humans.

Once computers can program, they basically take over technological progress because already, today, the majority of technological progress is run by software, by programming.

We don't exactly have the opposite interests to chimpanzees. However, things are not looking up for the chimpanzees, because we control their environment. Our interests are not perfectly aligned with theirs, and it turns out it's not easy to get interests aligned.

Giving the control over powerful AI to the highest bidder is unlikely to lead to the best world we can imagine.

In my view, the fact that computers caught up to humans and completely dominate humans in chess and some other domains already, that says there's evidence that, yes, in principle, they can be better programmers than humans.

I used to have the very standard worldview. I can easily identify with people who see computers getting faster and smarter, and technology getting more and more beneficial, without seeing the other side.