Say What? Chatbots Can Create Their Own Non-Human Language to Communicate

Facebook researchers have found that dialog agents being trained to negotiate will create their own non-human language to be more effective. What does this mean for the future of language?

Let's just hope the chatbots are gossiping behind our back.


You know that slight anxiousness you feel when two people are negotiating in a language you don't understand? Well, it turns out that chatbots are able to create their own non-human language to communicate back-and-forth. This was reported by researchers at Facebook Artificial Intelligence Research (FAIR), who were developing "dialog agents" with the newfound capability of negotiation. 

In order for bots to communicate more efficiently with other bots, they learned to create their own simple language.

"To go beyond simply trying to imitate people, the FAIR researchers instead allowed the model to achieve the goals of the negotiation. To train the model to achieve its goals, the researchers had the model practice thousands of negotiations against itself, and used reinforcement learning to reward the model when it achieved a good outcome. To prevent the algorithm from developing its own language, it was simultaneously trained to produce humanlike language."-Deal or no deal? Training AI bots to negotiate 

Is This a Big Deal?

On its face, it seems logical that chatbots would create their own language. If one of the major reasons why human language evolved is so we could more effectively convey our desires, it makes sense that bots aiming for efficiency would shortcut human imitation. At the same time, the concept of a non-human language further erodes the uniqueness we may feel as a human (given how central language has been to society's development).

The findings by the Facebook researchers falls on the heels of research from OpenAI, which in March 2017 reported the ability for bots to create their own language. Similar to the report by FAIR, the researchers found that bots were able to create their own language when going through reinforcement learning. 

The researchers from OpenAI set out to "teach AI agents to create language by dropping them into a set of simple worlds, giving them the ability to communicate, and then giving them goals that can be best achieved by communicating with other agents. If they achieve a goal, then they get rewarded. We train them using reinforcement learning and, due to careful experiment design, they develop a shared language to help them achieve their goals."

In the above video, one-word phrases were created by two agents to form simple tasks while the more challenging tasks by three agents led to multiple-word sentences. The rewarding of concise communication led to the development of a larger vocabulary. The researchers noted, however, that the bots had a tendency to turn whole sentences into one-word utterances (which wouldn't be desirable as an interpretable language).

Reinforcement Learning and the Creation of a Bot Langauge 

Reinforcement learning is a form of trial and error, where the bots are keeping track of what receives a reward and what doesn't. If the bot, or the "dialog agent" in the case if Facebook's research, receives a reward then it learns to continue that behavior. Agents are learning to modify their communication output to maximize the reward. As pointed out in FAIR's report, "[d]uring reinforcement learning, the agent attempts to improve its parameters from conversations with another agent."

The creation of the bot language came about when it was more efficient and more rewarding in bot-to-bot communication to have a shared language (as opposed to mimicking our human language). 

"[T]he researchers found that updating the parameters of both agents led to divergence from human language as the agents developed their own language for negotiating."-Deal or no deal? Training AI bots to negotiate 

 

So is it bad that the agents diverged from human language? It is if the goal is always to mimic human language and also retaining the ability to decipher bot-to-bot communication. Then again, we may soon have bot translators.

===

Want to connect? Reach out @TechEthicist and on Facebook. Exploring the ethical, legal, and emotional impact of social media & tech. Co-host of the upcoming show, Funny as Tech.

LinkedIn meets Tinder in this mindful networking app

Swipe right to make the connections that could change your career.

Getty Images
Sponsored
Swipe right. Match. Meet over coffee or set up a call.

No, we aren't talking about Tinder. Introducing Shapr, a free app that helps people with synergistic professional goals and skill sets easily meet and collaborate.

Keep reading Show less

Kosovo land swap could end conflict - or restart war

Best case: redrawing borders leads to peace, prosperity and EU membership. But there's also a worst case

Image: SRF
Strange Maps
  • The Yugoslav Wars started in 1991, but never really ended
  • Kosovo and Serbia are still enemies, and they're getting worse
  • A proposed land swap could create peace - or reignite the conflict

The death of Old Yugoslavia

Image: public domain

United Yugoslavia on a CIA map from 1990.

Wars are harder to finish than to start. Take for instance the Yugoslav Wars, which raged through most of the 1990s.

The first shot was fired at 2.30 pm on June 27th, 1991, when an officer in the Yugoslav People's Army took aim at Slovenian separatists. When the YPA retreated on July 7th, Slovenia was the first of Yugoslavia's republics to have won its independence.

After the wars

Image: Ijanderson977, CC BY-SA 3.0 / Wikimedia Commons

Map of former Yugoslavia in 2008, when Kosovo declared its independence. The geopolitical situation remains the same today.

The Ten-Day War cost less than 100 casualties. The other wars – in Croatia, Bosnia and Kosovo (1) – lasted much longer and were a lot bloodier. By early 1999, when NATO had forced Serbia to concede defeat in Kosovo, close to 140,000 people had been killed and four million civilians displaced.

So when was the last shot fired? Perhaps it wasn't: it's debatable whether the Yugoslav Wars are actually over. That's because Kosovo is a special case. Although inhabited by an overwhelming ethnic-Albanian majority, Serbians are historically very attached to it. More importantly, from a legalistic point of view: Kosovo was never a separate republic within Yugoslavia but rather a (nominally) autonomous province within Serbia.

Kosovo divides the world

Image: public domain

In red: states that recognise the independence of Kosovo (most EU member states – with the notable exceptions of Spain, Greece, Romania and Slovakia; and the U.S., Japan, Turkey and Egypt, among many others). In blue: states that recognise Serbia's sovereignty over Kosovo (most notably Russia and China, but also other major countries such as India, Brazil, Mexico, South Africa and Iran).

The government of Serbia has made its peace and established diplomatic relations with all other former Yugoslav countries, but not with Kosovo. In Serbian eyes, Kosovo's declaration of independence in 2008 was a unilateral and therefore legally invalid change of state borders. Belgrade officially still considers Kosovo a 'renegade province', and it actually has a lot of international support for that position (2).

The irony is that on the longer term, both Kosovo and Serbia want the same thing: EU membership. Ironically, that wish could lead to Yugoslav reunification some years down the road – within the EU. Slovenia and Croatia have already joined, and all other ex-Yugoslav states would like to follow their example. Macedonia, Montenegro and Serbia have already submitted an official application. The EU considers Bosnia and Kosovo 'potential candidates'.

Kosovo is the main stumbling block on Serbia's road to EU membership. Even after the end of hostilities, skirmishes continued, between the ethnically Albanian majority and the ethnically Serbian minority within Kosovo, and vice versa in Serbian territories directly adjacent. Tensions are dormant at best. A renewed outbreak of armed conflict is not unthinkable.

Land for peace?

Image: BBC

Mitrovica isn't the only area majority-Serb area in Kosovo, but the others are enclaved and fear being abandoned in a land swap.

In fact, relations between Kosovo and Serbia have deteriorated spectacularly in the past few months. At the end of November, Kosovo was refused membership of Interpol, mainly on the insistence of Serbia. In retaliation, Kosovo imposed a 100% tariff on all imports from Serbia. After which Serbia's prime minister Ana Brnabic refused to exclude her country's "option" to intervene militarily in Kosovo. Upon which Kosovo's government decided to start setting up its own army – despite its prohibition to do so as one of the conditions of its continued NATO-protected independence.

The protracted death of Yugoslavia will be over only when this conflict is finally resolved. The best way to do that, politicians on both sides have suggested, is for the borders reflect the ethnic makeup of the frontier between Kosovo and Serbia.

The biggest and most obvious pieces of the puzzle are the Serbian-majority district of Mitrovica in northern Kosovo, and the Albanian-majority Presevo Valley, in southwestern Serbia. That land swap was suggested previous summer by Hashim Thaci and Aleksandar Vucic, presidents of Kosovo and Serbia respectively. Best-case scenario: that would eliminate the main obstacle to mutual recognition, joint EU membership and future prosperity.

If others can do it...

Image: Ruland Kolen

Belgium and the Netherlands recently adjusted out their common border to conform to the straightened Meuse River.

Sceptics and not a few locals warn that there also is a worst-case scenario: the swap could rekindle animosities and restart the war. A deal along those lines would almost certainly exclude six Serbian-majority municipalities enclaved deep within Kosovo. While Serbian Mitrovica, which borders Serbia proper, is home to some 40,000 inhabitants, those enclaves represent a further 80,000 ethnic Serbs – who fear being totally abandoned in a land swap, and eventually forced out of their homes.

Western powers, which sponsored Kosovar independence, are divided over the plan. U.S. officials back the idea, as do some within the EU. But the Germans are against – they are concerned about the plan's potential to fire up regional tensions rather than eliminate them.

In principle, countries consider their borders inviolate and unchanging, but land swaps are not unheard of. Quite recently, Belgium and the Netherlands exchanged territories so their joint border would again match up with the straightened course of the Meuse river (3). But those bits of land were tiny, and uninhabited. And as the past has amply shown, borders carry a lot more weight in the Balkans.

Keep reading Show less

Scientists claim the Bible is written in code that predicts future events

The controversy around the Torah codes gets a new life.

Michael Drosnin
Surprising Science
  • Mathematicians claim to see a predictive pattern in the ancient Torah texts.
  • The code is revealed by a method found with special computer software.
  • Some events described by reading the code took place after the code was written.
Keep reading Show less
Videos
  • Facebook and Google began as companies with supposedly noble purposes.
  • Creating a more connected world and indexing the world's information: what could be better than that?
  • But pressure to return value to shareholders came at the expense of their own users.
Keep reading Show less