Teaching Robots the Most Powerful Word in the English Language

“I'm sorry Dave; I'm afraid I can't do that.”

We're bearing witness to an interesting time in technological development: the rise of robot servants. They'll soon be in our cars (if they haven't been uploaded to your vehicle already) and delivering our Amazon packages. Many dream of one day having a robot butler that will service their every need. But what if a human gives a command that could do harm? Or one that may put the robot at risk?

Researchers Gordon Briggs and Matthias Scheutz, from Tufts University, are working on a mechanism to teach robots to say, "No," to their human overlords. The system is one that allows a robot to not only understand the language of a command, but the larger context — whether the robot is actually capable of executing it.

A series of conditions, known as felicity conditions, must hold in order for the robot to accept the proposed action. The researchers write:

1. Knowledge: Do I know how to do X?
2. Capacity: Am I physically able to do X now? Am I normally physically able to do X?
3. Goal priority and timing: Am I able to do X right now?
4. Social role and obligation: Am I obligated based on my social role to do X?
5. Normative permissibility: Does it violate any normative principle to do X?

In the video below, the researchers demonstrate how a robot might process a command to walk forward when an obstacle is in the way, reasoning that a command to walk forward is wrong.

The ethical debates surrounding robots in mainstream society is still a heated one. It's an area Jerry Kaplan talks about quite a bit, questioning how our laws will adapt to punish wrong-doing robots. He says humans are “going to need new kinds of laws that deal with the consequences of well-intentioned autonomous actions that robots take.”

But what about the well-intentioned robots with ill-intentioned owners?


Natalie has been writing professionally for about 6 years. After graduating from Ithaca College with a degree in Feature Writing, she snagged a job at PCMag.com where she had the opportunity to review all the latest consumer gadgets. Since then she has become a writer for hire, freelancing for various websites. In her spare time, you may find her riding her motorcycle, reading YA novels, hiking, or playing video games. Follow her on Twitter: @nat_schumaker

Photo Credit: Getty Images / Staff

LinkedIn meets Tinder in this mindful networking app

Swipe right to make the connections that could change your career.

Getty Images
Swipe right. Match. Meet over coffee or set up a call.

No, we aren't talking about Tinder. Introducing Shapr, a free app that helps people with synergistic professional goals and skill sets easily meet and collaborate.

Keep reading Show less

What’s behind our appetite for self-destruction?

Is it "perverseness," the "death drive," or something else?

Photo by Brad Neathery on Unsplash
Mind & Brain

Each new year, people vow to put an end to self-destructive habits like smoking, overeating or overspending.

Keep reading Show less

34 years ago, a KGB defector chillingly predicted modern America

A disturbing interview given by a KGB defector in 1984 describes America of today and outlines four stages of mass brainwashing used by the KGB.

Politics & Current Affairs
  • Bezmenov described this process as "a great brainwashing" which has four basic stages.
  • The first stage is called "demoralization" which takes from 15 to 20 years to achieve.
  • According to the former KGB agent, that is the minimum number of years it takes to re-educate one generation of students that is normally exposed to the ideology of its country.
Keep reading Show less

Douglas Rushkoff – It’s not the technology’s fault

It's up to us humans to re-humanize our world. An economy that prioritizes growth and profits over humanity has led to digital platforms that "strip the topsoil" of human behavior, whole industries, and the planet, giving less and less back. And only we can save us.

Think Again Podcasts
  • It's an all-hands-on-deck moment in the arc of civilization.
  • Everyone has a choice: Do you want to try to earn enough money to insulate yourself from the world you're creating— or do you want to make the world a place you don't have to insulate yourself from?
Keep reading Show less