Why creating an AI that has free will would be a huge mistake

Giving human rights to a being with unlimited knowledge? Probably not a good idea.

Joanna Bryson: First of all there’s the whole question about why is it that we in the first place assume that we have obligations towards robots?

So we think that if something is intelligent, then that’s their special source, that’s why we have moral obligations. And why do we think that?

Because most of our moral obligations, the most important thing to us is each other.

So basically morality and ethics are the way that we maintain human society, including by doing things like keeping the environment okay, you know, making it so we can live.

So, one of the ways we characterize ourselves is as intelligent, and so when we then see something else and say, “Oh it’s more intelligent, well then maybe it needs even more protection.”

In AI we call that kind of reasoning heuristic reasoning: it’s a good guess that will probably get you pretty far, but it isn’t necessarily true.

I mean, again, how you define the term “intelligent” will vary. If you mean by “intelligent” a moral agent, you know, something that’s responsible for its actions, well then, of course, intelligence implies moral agency.

When will we know for sure that we need to worry about robots? Well, there’s a lot of questions there, but consciousness is another one of those words. The word I like to use is “moral patient”. It’s a technical term that the philosophers came up with, and it means, exactly, something that we are obliged to take care of.

So now we can have this conversation.

If you just mean “conscious means moral patient”, then it’s no great assumption to say “well then, if it’s conscious then we need to take care of it”. But it’s way more cool if you can say, “Does consciousness necessitate moral patiency?” And then we can sit down and say, “well, it depends what you mean by consciousness.” People use consciousness to mean a lot of different things.

So one of the things that we did last year, which was pretty cool, the headlines, because we were replicating some psychology stuff about implicit bias—actually the best one is something like “Scientists Show That A.I. Is Sexist and Racist, and It’s Our Fault,” which that’s pretty accurate, because it really is about picking things up from our society.

Anyway, the point was, so here is an AI system that is so human-like that it’s picked up our prejudices and whatever… and it’s just vectors! It’s not an ape. It’s not going to take over the world. It’s not going to do anything, it’s just a representation; it’s like a photograph.

We can’t trust our intuitions about these things.

We give things rights because that’s the best way we can find to handle very complicated situations. And the things that we give rights are basically people.

I mean some people argue about animals, but technically, and again this depends on whose technical definition you use, but technically rights are usually things that come with responsibilities and that you can defend in a court of law.

So normally we talk about animal welfare and we talk about human rights, but with artificial intelligence you can even imagine itself knowing its rights and defending itself in the court of law. But the question is, why would we need to protect the artificial intelligence with rights? Why is that the best way to protect it?

So with humans it’s because we’re fragile, it’s because there’s only one of us. And I actually think—this is horribly reductionist, but I actually think—it’s just the best way that we’ve found to be able to cooperate. It’s sort of an acknowledgment of the fact that we’re all basically the same thing, the same stuff, and we had to come up with, the technical term again is equilibrium, we had to come up with some way to share the planet, and we haven't managed to do it completely fairly (like ‘everybody gets the same amount of space’), but actually we all want to be recognized for our achievements so even completely fair isn’t completely fair, if that makes sense.

And I don’t mean to be facetious there, it really is true that you can’t make all the things you would like out of fairness be true at once.

That’s a fact about the world; it’s a fact about the way we define fairness.

So, given how hard it is to be fair, why should we build AI that needs us to be fair to it?

So what I’m trying to do is just make the problem simpler and focus us on the thing that we can’t help, which is the human condition.

And I’m recommending that if you specify something, if you say okay this is when you really need rights in this context, okay once we’ve established that, don’t build that, okay?

A lot of people this rubs them the wrong way like its because they’ve watched Blade Runner or AI the movie or something like this.

In a lot of these movies we’re not really talking about AI, we’re not talking about something designed from the ground up, we’re talking basically about clones.

And clones are a different situation. If you have something that’s exactly like a person, however it was made, then okay, then it’s exactly like a person and it needs that kind of protection.

But even biological clones, even if you just want to clone yourself, at least in the European Union, that’s illegal. I’m not sure about in America. I think it’s illegal in America too.

But people think it’s unethical to create human clones partly because they don’t want to burden someone with the knowledge that they’re supposed to be someone else, that there was some other person that chose them to be that person. I don’t know if we’ll be able to stick to that, but I would say that AI clones fall into the same category.

If you’re really going to make something and then say, “Hey, congratulations, you’re me and you have to do what I say,” I wouldn’t want myself to tell me what to do, if that makes sense, if there were two of me!

I think we’d like to be able to both be equals, and so you don’t want to have—an artifact is something you’ve deliberately built and that you’re going to own.

If you have something that’s sort of a humanoid servant that you own, then the word for that is slave.

And so I was trying to establish that look, we are going to own anything we build, and so therefore it would be wrong to make it a person, because we’ve already established that slavery of people is wrong and bad and illegal.

And so it never occurred to me that people would take that to mean that “the robots will be people that we just treat really badly. “

It’s like no, that’s exactly the opposite!

So, I already mentioned that if somebody did manage to clone people somehow, which I don’t believe this is ever going to work but people do talk about it and people spending tens of millions of dollars on it, “whole brain uploading”. So I don’t believe it’s possible. I don’t think it’s actually computationally tractable, but if that were to happen then I would be there saying, “Yes this is a person”. But how can we stop that the same way we stop human cloning, which is just to say, “Don’t do that”?

And particularly with AI my point is that it shouldn’t be a commercial product.

So if somebody does this in their basement or something well then we have a few exceptions, but I’m much more concerned about people mass producing such things.

Joanna Bryson thinks that people are confusing artificial intelligence with human clones, mostly due to Hollywood movies like Blade Runner and Steven Spielberg's A.I., both of which feature very humanoid beings. Take away the somewhat cuddly ideas the movies have given us about artificial intelligence and you have this: hyper-smart machines with absolutely no limit to their knowledge. She posits that giving artificial intelligence the same rights a human has could result in pretty dire consequences... because AI has already proven that it can pick up negative human characteristics if those characteristics are in the data. Therefore, it's not crazy at all to think that AI could scan all of Twitter in one afternoon and pick up all the negativity we've unloaded there. If it's already proven it's not only capable of making the wrong decision but eventually will make the wrong decision when it comes to data mining and implementation, why even give it the same powers as us in the first place?

Malcolm Gladwell live | How to re-examine everything you know

Join Radiolab's Latif Nasser at 1pm ET on Monday as he chats with Malcolm Gladwell live on Big Think.

Big Think LIVE

Add event to your calendar

AppleGoogleOffice 365OutlookOutlook.comYahoo

Keep reading Show less

To be a great innovator, learn to embrace and thrive in uncertainty

Innovators don't ignore risk; they are just better able to analyze it in uncertain situations.

David McNew/Getty Images
Personal Growth
Madam C.J. Walker, born Sarah Breedlove, was America's first female self-made millionaire.
Keep reading Show less

All of Jimi Hendrix’s gigs in one beautiful flash

Remarkable 'fan art' commemorates 50th anniversary of legendary guitar player's passing.

Image: Owen Powell, reproduced with kind permission.
Strange Maps
  • Legendary rock guitarist Jimi Hendrix died exactly 50 years ago today.
  • From September 1966 to his death, he performed over 450 times.
  • This spectacular 'gigograph' shows the geographic dimension of his short but busy career.
Keep reading Show less

There are 5 eras in the universe's lifecycle. Right now, we're in the second era.

Astronomers find these five chapters to be a handy way of conceiving the universe's incredibly long lifespan.

Image source: Pablo Carlos Budassi
Surprising Science
  • We're in the middle, or thereabouts, of the universe's Stelliferous era.
  • If you think there's a lot going on out there now, the first era's drama makes things these days look pretty calm.
  • Scientists attempt to understand the past and present by bringing together the last couple of centuries' major schools of thought.
Keep reading Show less

Airspeeder's ‘flying car’ racers to be shielded by virtual force-fields

Welcome to the world's newest motorsport: manned multicopter races that exceed speeds of 100 mph.

Credit: Airspeeder
Technology & Innovation
  • Airspeeder is a company that aims to put on high-speed races featuring electric flying vehicles.
  • The so-called Speeders are able to fly at speeds of up to 120 mph.
  • The motorsport aims to help advance the electric vertical take-off and landing (eVTOL) sector, which could usher in the age of air taxis.
Keep reading Show less