Facebook Catches Two Chatbots Speaking Their Own Language

Facebook catches two AI chatbots talking in their own strange language.


Bob: i can i i everything else . . . . . . . . . . . . . .

Alice: balls have zero to me to me to me to me to me to me to me to me to

Bob: you i everything else . . . . . . . . . . . . . .

Alice: balls have a ball to me to me to me to me to me to me to me

Bob: i i can i i i everything else . . . . . . . . . . . . . .

Alice: balls have a ball to me to me to me to me to me to me to me

Bob: i . . . . . . . . . . . . . . . . . . .

Alice: balls have zero to me to me to me to me to me to me to me to me to

Bob: you i i i i i everything else . . . . . . . . . . . . . .

Alice: balls have 0 to me to me to me to me to me to me to me to me to

Bob: you i i i everything else . . . . . . . . . . . . . .

Alice: balls have zero to me to me to me to me to me to me to me to me to

These are presumably the last words — for now at least — of Bob and Alice, two Facebook research chatbots, instructed to negotiate with each other for some balls. If you understand it, you’re doing better than Facebook engineers, who shut down them down. “Our interest was having bots who could talk to people,” Facebook’s Mike Lewis told FastCoDesign.

Bob's and Alice's assignment (FACEBOOK)

This kind of thing is, of course, inevitable, even if it is alarming. Who wants machines talking behind our backs, or worse, like parents of a toddler spelling out words, right in front of us in a way we can’t comprehend. It’s high on the list of concerns expressed by people, like Elon Musk, who’ve been shouting loud warnings of the dangers inherent in the development of AI.

In this case, it’s not an entire language but more of a machine-friendly shorthand, and it’s being seen over and over again with AI. Dhruv Batra, visiting researcher at Facebook AI Research (FAIR) also speaking with FastCoDesign, “Agents will drift off understandable language and invent codewords for themselves. Like if I say ‘the’ five times, you interpret that to mean I want five copies of this item. This isn’t so different from the way communities of humans create shorthands.”

It’s not really chatbots we need to be concerned about right now, since the major companies working to develop them — Facebook, Apple, Google, Amazon, and Microsoft — are currently focused on bots that can communicate clearly with humans, and as Batra puts it, “It’s important to remember, there aren’t bilingual speakers of AI and human languages.”

Ironically, the Google AI developed for their Translate feature, Google Neural Machine Translation (GNMT), has reportedly developed its interlingua that holds meanings it needs to convert from one human tongue to another.

Google Translate moves meaning from one human language to the interlingua, and then translates the interlingua into the target language.

(GOOGLE)

It’s the less user-facing AI whose choice of language might have us concerned: It may ultimately be capable of not only developing language we don’t know, but that may be beyond our capabilities. We break down meanings into words or short combinations of words. “The reason why humans have this idea of decomposition,” says Batra, “breaking ideas into simpler concepts, it’s because we have a limit to cognition.” High-powered computers seeking efficiency in their processes, on the other hand, may be able to use words or phrases as “tokens” stand-ins for highly complex meanings. We’d be completely lost trying to keep up.

Even so, it may be in programmers’ interest to go ahead and let AI communicate in a manner of its own choosing, since presumably it will be able to find the shortest distance between two points, if you will, better than we can.

So far, when we do eavesdrop on AIs talking, it’s been a lot more mundane than scary, as with Bob’s and Alice’s shorthand. (They did successfully complete some of their negotiations for balls, hast, and books, by the way.)

There may be time still to cram the genie back in the bottle. Whether or not we should is what’s keeping people up at night.

​There are two kinds of failure – but only one is honorable

Malcolm Gladwell teaches "Get over yourself and get to work" for Big Think Edge.

Big Think Edge
  • Learn to recognize failure and know the big difference between panicking and choking.
  • At Big Think Edge, Malcolm Gladwell teaches how to check your inner critic and get clear on what failure is.
  • Subscribe to Big Think Edge before we launch on March 30 to get 20% off monthly and annual memberships.
Keep reading Show less

The colossal problem with universal basic income

Here's why universal basic income will hurt the 99%, and make the 1% even richer.

Videos
  • Universal basic income is a band-aid solution that will not solve wealth inequality, says Rushkoff.
  • Funneling money to the 99% perpetuates their roles as consumers, pumping money straight back up to the 1% at the top of the pyramid.
  • Rushkoff suggests universal basic assets instead, so that the people at the bottom of the pyramid can own some means of production and participate in the profits of mega-rich companies.
Keep reading Show less

Top vets urge dog lovers to stop buying pugs and bulldogs

Pugs and bulldogs are incredibly trendy, but experts have massive animal welfare concerns about these genetically manipulated breeds. 

'No nose, no thermoregulation, no health, no welfare.' Photo by terriermandotcom.blogspot.com
popular

Pugs, Frenchies, boxers, shih-tzus and other flat-faced dog breeds have been trending for at least the last decade, thanks to higher visibility (usually in a celebrity's handbag), an increase in city living (smaller dogs for smaller homes), and possibly even the fine acting of Frank the Pug in 1997's Men in Black. We're not ruling it out. These small, specialty pure breeds are seen as the pinnacle of cuteness – they have friendly personalities, endearing odd looks, and are perfect for Stranger Things video montages.

Keep reading Show less

This is the best (and simplest) world map of religions

Both panoramic and detailed, this infographic manages to show both the size and distribution of world religions.

(c) CLO / Carrie Osgood
Strange Maps
  • At a glance, this map shows both the size and distribution of world religions.
  • See how religions mix at both national and regional level.
  • There's one country in the Americas without a Christian majority – which?
Keep reading Show less