Scientists are studying your Twitter slang to help AI
Mathematicians studied 100 billion tweets to help computer algorithms better understand our colloquial digital communication.
- A group of mathematicians from the University of Vermont used Twitter to examine how young people intentionally stretch out words in text for digital communication.
- Analyzing the language in roughly 100 billion tweets generated over eight years, the team developed two measurements to assess patterns in the tweets: balance and stretch.
- The words people stretch are not arbitrary but rather have patterned distributions such as what part of the word is stretched or how much it stretches out.
What? whaat. WHAT? Whaaaattt?
While all of the above are expressions of confusion, you understand them to mean slightly different things. That's based upon the way you imagine the word to sound signified by the repetition of or emphasis put on certain letters. The underlying meaning imbued within our vernacular, slang, and deliberately misspelled words is how we lace our digital communication with human emotion.
Which has, coincidentally, proved to be one of the major challenges for language-processing artificial intelligence. But scientists are trying, and they're studying our Twitter lingo to bring computers up to speed on how humans really communicate.
Balance and Stretch
Photo credit: Dole777 / Unsplash
Over the last two decades, social media has provided scientists with a trove of free information about human behavior and language. A group of mathematicians from the University of Vermont used Twitter to examine how young people intentionally stretch out words in text for digital communication. They created a method to essentially quantify the semantic nuances in between stretched words, like "right" vs. "riiiiiight," with the aim to teach future AI algorithms human digital colloquialisms.
"Written communication has recently begun encoding new forms of expression, including the emotional emphasis delivered by stretching words out," said Chris Danforth, professor of Mathematics & Statistics in the Vermont Complex Systems Center and member of the research team behind the study.
In their study, published last week in the journal PLOS One, the team analyzed the language in roughly 100 billion tweets generated from 2008 to 2016. They developed two measurements to assess patterns in the tweets: balance and stretch. For example hahahaha would be considered a stretched world high on balance while a term like wtffffff has stretch but little balance as only one letter, f, contributes to the stretchiness. This means to put emphasis on the world abbreviated by the letter "f".
"With so much communication happening electronically these days, we're all trying to find ways to convey emotion through text. Emojis are helping, but the visual effect of 30 consecutive vowels in a curse word turns a bland profanity into a form of art," Danforth said.
Interestingly, the use of elongated words was found across languages. For example, "kkkkkkk" signifies laughter in Brazilian Portuguese while "wkwkwkwkwkwk" expresses it in Indonesian, according to the researchers.
Beyond the dictionary
Ultimately, this project could help artificial intelligence algorithms understand critical intrinsic meanings contained in the idiosyncratic variations in our communicative text or other linguistic symbols, such as punctuation and emojis.
Dictionary definitions hardly reflect the way that we actually communicate with one another digitally. What the researchers found, though, is that the words people stretch out aren't arbitrary. Rather, they have patterned distributions such as what part of the word is stretched or how much it stretches out. Colloquial digital language is, after all, a system of symbols and for it to transfer meaning we must all be "in" on the patterns.
This research suggests that by gaining understanding into stretched words used on social media opens more doors to helping AI better understand our slang. Tools and methods were developed that could be useful in future studies, for example investigations of intentional mis-typings and misspellings.
What benefits come from AI algorithms better understanding our digital lingo? For one, it's possible that new tools could be applied to improve natural language processing, search engines, and spam filters.
"We were able to comprehensively collect and count stretched words like 'gooooooaaaalll' and 'hahahaha'," the researchers said in a press release, "and map them across the two dimensions of overall stretchiness and balance of stretch, while developing new tools that will also aid in their continued linguistic study, and in other areas, such as language processing, augmenting dictionaries, improving search engines, analyzing the construction of sequences, and more."
What would happen if you tripled the US population? Join Matthew Yglesias and Charles Duhigg at 1pm ET on Monday, September 28.
Philosopher Nick Bostrom's "singleton hypothesis" predicts the future of human societies.
- Nick Bostrom's "singleton hypothesis" says that intelligent life on Earth will eventually form a "singleton".
- The "singleton" could be a single government or an artificial intelligence that runs everything.
- Whether the singleton will be positive or negative depends on numerous factors and is not certain.
Want to Retain American Jobs? Stop Blaming Globalization<div class="rm-shortcode" data-media_id="oxK8j1xN" data-player_id="FvQKszTI" data-rm-shortcode-id="2cf425d7b91ed2a6fc4fe19d065f3408"> <div id="botr_oxK8j1xN_FvQKszTI_div" class="jwplayer-media" data-jwplayer-video-src="https://content.jwplatform.com/players/oxK8j1xN-FvQKszTI.js"> <img src="https://cdn.jwplayer.com/thumbs/oxK8j1xN-1920.jpg" class="jwplayer-media-preview" /> </div> <script src="https://content.jwplatform.com/players/oxK8j1xN-FvQKszTI.js"></script> </div>
Dominique Crenn, the only female chef in America with three Michelin stars, joins Big Think Live.
Having been exposed to mavericks in the French culinary world at a young age, three-star Michelin chef Dominique Crenn made it her mission to cook in a way that is not only delicious and elegant, but also expressive, memorable, and true to her experience.
Controversial physics theory says reality around us behaves like a computer neural network.
- Physicist proposes that the universe behaves like an artificial neural network.
- The scientist's new paper seeks to reconcile classical physics and quantum mechanics.
- The theory claims that natural selection produces both atoms and "observers".
Vanchurin interview:<span style="display:block;position:relative;padding-top:56.25%;" class="rm-shortcode" data-rm-shortcode-id="539759cbfd8fcd5b6ebf14a3b597b3f9"><iframe type="lazy-iframe" data-runner-src="https://www.youtube.com/embed/bmyRy2-UhEE?rel=0" width="100%" height="auto" frameborder="0" scrolling="no" style="position:absolute;top:0;left:0;width:100%;height:100%;"></iframe></span>
Vanchurin on “Hidden Phenomena”:<span style="display:block;position:relative;padding-top:56.25%;" class="rm-shortcode" data-rm-shortcode-id="18886ffd5e5840bb19d4494212f88d82"><iframe type="lazy-iframe" data-runner-src="https://www.youtube.com/embed/2NDVdNwsHCo?rel=0" width="100%" height="auto" frameborder="0" scrolling="no" style="position:absolute;top:0;left:0;width:100%;height:100%;"></iframe></span>Vitaly Vanchurin speaking at the 6th International FQXi Conference, "Mind Matters: Intelligence and Agency in the Physical World." The Foundational Questions...
43% of people think they can get a sense of someone's personality by their picture.
If you've used a dating app, you'll know the importance of choosing good profile pics.
Quarantine rule breakers in 17th-century Italy partied all night – and some clergy condemned the feasting
17th-century outbreaks of plague in Italy reveal both tensions between religious and public health authorities.