Will Robots Dream of Electric Anythings?

Today Paul Waldman interviews James Barrat, author of Our Final Invention: Artificial Intelligence and the End of the Human Era. I thought this was an interesting assertion:

Furthermore, at an advanced level, as I write in Our Final Invention, citing the work of AI-maker and theorist Steve Omohundro, artificial intelligence will have drives much like our own, including self-protection and resource acquisition. It will want to achieve its goals and marshal sufficient resources to do so. It will want to avoid being turned off. When its goals collide with ours it will have no basis for valuing our goals, and use whatever means are at its disposal for achieving its goals.

But why? Animals have these drives because we evolved them. In the biological world, these are extremely survival-adaptive traits, and species that have them will outbreed species that don’t. But they have nothing to do with intelligence or consciousness. They’re mindless drives that we possess for no reason except that all of our ancestors possessed them and then passed them down to us.

Intelligent machines might end up having these drives, but then again, they might not. There’s no special reason that an AI construct would be especially curious, or fearful of death, or expansion-minded, or any of the other things we almost automatically associate with intelligence. Intelligent machines might not care one way or the other if they’re shut off. They might not want more resources. They might not care about running the world. All of these mindless drives that so dominate biological life might be matters of no urgency at all to a machine that didn’t evolve them.

Then again, they might be. But I don’t think it’s inevitable.


Headshot of Editor in Chief of Mother Jones, Clara Jeffery

It sure feels that way to me, and here at Mother Jones, we’ve been thinking a lot about what journalism needs to do differently, and how we can have the biggest impact.

We kept coming back to one word: corruption. Democracy and the rule of law being undermined by those with wealth and power for their own gain. So we're launching an ambitious Mother Jones Corruption Project to do deep, time-intensive reporting on systemic corruption, and asking the MoJo community to help crowdfund it.

We aim to hire, build a team, and give them the time and space needed to understand how we got here and how we might get out. We want to dig into the forces and decisions that have allowed massive conflicts of interest, influence peddling, and win-at-all-costs politics to flourish.

It's unlike anything we've done, and we have seed funding to get started, but we're looking to raise $500,000 from readers by July when we'll be making key budgeting decisions—and the more resources we have by then, the deeper we can dig. If our plan sounds good to you, please help kickstart it with a tax-deductible donation today.

Thanks for reading—whether or not you can pitch in today, or ever, I'm glad you're with us.

Signed by Clara Jeffery

Clara Jeffery, Editor-in-Chief

payment methods

We Recommend