Self-Motivation
David Goggins
Former Navy Seal
Career Development
Bryan Cranston
Actor
Critical Thinking
Liv Boeree
International Poker Champion
Emotional Intelligence
Amaryllis Fox
Former CIA Clandestine Operative
Management
Chris Hadfield
Retired Canadian Astronaut & Author
Learn
from the world's big
thinkers
Start Learning

Future of mixed reality: How augmented and virtual worlds will collide

A primer on the amazing possibilities of mixed reality, augmented reality, and virtual reality technology.

Star Wars "Find the Force" treasure hunt (Billy H.C. Kwok / Getty Images for Disney)


New and exciting realities are now just a few screens away. The wildest dreams of science fiction writers are slowly seeping their way into our current day and age. Many people are familiar with virtual reality (VR). You put on some kind of headset and you’re whisked into an all-encompassing world of sound and sight. VR’s close cousin, augmented reality (AR), comes in a few different forms – overlaid blocks of text and information, sometimes cartoonish images and games that let you interact with the world around you. Both of these types of tech have earned their namesake, but what about when you combine the two of them?

The border between these digital worlds is already beginning to break down. Mixed reality (MR)is the intersection of both AR and VR. Right now the biggest player in the mixed reality space is Microsoft, which is leading the way with its Hololens headset. In order to learn more about MR, we need to look a little deeper at both augmented and virtual realities.

A Primer on Different Digital Realities

So much is happening in the world of digital realities that it can become puzzling to try and draw a distinction between VR, AR, and MR.  But each one of these realities can be quickly explained:

  • Virtual reality (VR) immerses a user in a digital environment like a video game.

  • Augmented reality (AR) places digital objects over a real-world view.

  • Mixed reality (MR) overlays and anchors virtual things in a real-world environment.  

For VR, a computer generates the virtual environment that users then explore and interact with. Special hand controllers help to enhance and integrate the body into the entire virtual experience. An ideal virtual world will be completely cut off from the outside visual view, along with noise-canceling headphones.  

In an augmented reality, users interact with the real world while virtual content is added to the screen. Think of the quickly viral video game Pokemon Go or some Snapchat features that add digital avatars to the world around you. Most of the current AR is experienced through smartphones. There has been a mixed reaction to AR glasses, and no clear leader has emerged in that space yet – especially after Google’s failed Google Glass experiment.  

You can also access virtual worlds through 360-degree video, which is also considered as another form of VR. If for example, you wear a Google Cardboard, you’ll be able to view any type of 360 video with your headset.  

You must wear a specialized VR headset to experience any kind of virtual reality. Most headsets are connected to a computer or gaming console. Oculus Rift, HTC Vive, and PlayStation VR are some of the more advanced and most popular devices in the space. Other affordable options include the Google Cardboard. These types of standalone VR headsets work in tandem with a headset.

Mixed Reality On the Scene

The most recent development in reality technologies has given us a few forms of mixed reality. One type of MR is the ability to not only overlay objects on the real world but interact with them as well. This is a kind of advanced type of AR. Another interesting form of MR takes its cue from a completely immersed virtual environment where the real world is blocked out. At first, it sounds like just plain virtual reality. But in this instance, the virtual environment that you see is tethered to and overlaps the real world environment. Here’s an example of how this works --   

Mixed reality fuses layered objects into the real world with an immersive digital world, allowing you to do things not possible in a strictly AR or VR digital environment. The cutting-edge paradigm shift into MR has been made possible with the Microsoft Hololens - a headset that as the name would suggest, allows its users to overlay holograms from virtual worlds on top of regular old reality. Essentially, it creates the feeling of being present within a virtual environment.   

This type of intersection between the real and virtual gives us an entirely new space that we can interact and innovate inside of. We’ll be unearthing a whole new expanse of possibilities as the technology grows.

 New Mediums of Experience

If we’re to take a page from Marshall McLuhan, mid 20th-century media theorist, our new mediums of technology will begin to radically alter our perceptions of ourselves and reality regardless of the content. A famous McLuhan quote puts it simply:

“We become what we behold. We shape our tools and then our tools shape us.”

Virtual and mixed realities will be no different and will completely change our way of doing things and viewing our world. Look no further than actually trying to explain and differentiate between these realities. It will become more difficult throughout the years as these once novel technologies will be completely integrated into our lives. No one thinks much about having a supercomputer in their pocket anymore. It’s become a normal mode of existence. AR, VR and the junction point of mixed reality is the next logical step.

Reality is almost becoming gamified. One day surgeons should be able to overlay x-ray or ultrasound images over a patient while they operate on them. Designers and artists will be able to collaborate with another from miles away and project an imagined idea into a real-life space. Drones traversing the sky will instantly relay quantifiable information about the world while they fly. Different perspectives and another person’s point of view will seamlessly become a visual activity to participate in. There’s no end in sight to what’s possible.

A Future of Possibility

Inventors and artists are the ones who tend to lead the way when it comes to future technology. Our ability to transform the world and our lives is limited only to our imagination. With mixed reality, we’re given a blank canvas over the rich and vast natural environment. It’s almost as if the internet has found a new conduit or rather a physical manifestation of itself and divorced itself from the computer screen. This very well could be the beginning of a seismic shift of our shared technological realities.  

Neom, Saudi Arabia's $500 billion megacity, reaches its next phase

Construction of the $500 billion dollar tech city-state of the future is moving ahead.

Credit: Neom
Technology & Innovation
  • The futuristic megacity Neom is being built in Saudi Arabia.
  • The city will be fully automated, leading in health, education and quality of life.
  • It will feature an artificial moon, cloud seeding, robotic gladiators and flying taxis.
Keep reading Show less

Tuberculosis vaccine shows promise in reducing COVID deaths

A new study suggests that a century-old vaccine may reduce the severity of coronavirus cases.

Closeup of a BCG vaccination.

Credit: Kekyalyaynen.
Surprising Science
  • A new study finds a country's tuberculosis BCG vaccination is linked to its COVID-19 mortality rate.
  • More BCG vaccinations is connected to fewer severe coronavirus cases.
  • The study is preliminary and more research is needed to support the findings.
Keep reading Show less

Human brains remember certain words more easily than others

A study of the manner in which memory works turns up a surprising thing.

Image Point Fr / Shutterstock
Mind & Brain
  • Researchers have found that some basic words appear to be more memorable than others.
  • Some faces are also easier to commit to memory.
  • Scientists suggest that these words serve as semantic bridges when the brain is searching for a memory.

Cognitive psychologist Weizhen Xie (Zane) of the NIH's National Institute of Neurological Disorders and Stroke (NINDS) works with people who have intractable epilepsy, a form of the disorder that can't be controlled with medications. During research into the brain activity of patients, he and his colleagues discovered something odd about human memory: It appears that certain basic words are consistently more memorable than other basic words.

The research is published in Nature Human Behaviour.

An odd find

Image source: Tsekhmister/Shutterstock

Xie's team was re-analyzing memory tests of 30 epilepsy patients undertaken by Kareem Zaghloul of NINDS.

"Our goal is to find and eliminate the source of these harmful and debilitating seizures," Zaghloul said. "The monitoring period also provides a rare opportunity to record the neural activity that controls other parts of our lives. With the help of these patient volunteers we have been able to uncover some of the blueprints behind our memories."

Specifically, the participants were shown word pairs, such as "hand" and "apple." To better understand how the brain might remember such pairings, after a brief interval, participants were supplied one of the two words and asked to recall the other. Of the 300 words used in the tests, five of them proved to be five times more likely to be recalled: pig, tank, doll, pond, and door.

The scientists were perplexed that these words were so much more memorable than words like "cat," "street," "stair," "couch," and "cloud."

Intrigued, the researchers looked at a second data source from a word test taken by 2,623 healthy individuals via Amazon's Mechanical Turk and found essentially the same thing.

"We saw that some things — in this case, words — may be inherently easier for our brains to recall than others," Zaghloul said. That the Mechanical Turk results were so similar may "provide the strongest evidence to date that what we discovered about how the brain controls memory in this set of patients may also be true for people outside of the study."

Why understanding memory matters

person holding missing piece from human head puzzle

Image source: Orawan Pattarawimonchai/Shutterstock

"Our memories play a fundamental role in who we are and how our brains work," Xie said. "However, one of the biggest challenges of studying memory is that people often remember the same things in different ways, making it difficult for researchers to compare people's performances on memory tests." He added that the search for some kind of unified theory of memory has been going on for over a century.

If a comprehensive understanding of the way memory works can be developed, the researchers say that "we can predict what people should remember in advance and understand how our brains do this, then we might be able to develop better ways to evaluate someone's overall brain health."

Party chat

Image source: joob_in/Shutterstock

Xie's interest in this was piqued during a conversation with Wilma Bainbridge of University of Chicago at a Christmas party a couple of years ago. Bainbridge was, at the time, wrapping up a study of 1,000 volunteers that suggested certain faces are universally more memorable than others.

Bainbridge recalls, "Our exciting finding is that there are some images of people or places that are inherently memorable for all people, even though we have each seen different things in our lives. And if image memorability is so powerful, this means we can know in advance what people are likely to remember or forget."

spinning 3D model of a brain

Temporal lobes

Image source: Anatomography/Wikimedia

At first, the scientists suspected that the memorable words and faces were simply recalled more frequently and were thus easier to recall. They envisioned them as being akin to "highly trafficked spots connected to smaller spots representing the less memorable words." They developed a modeling program based on word frequencies found in books, new articles, and Wikipedia pages. Unfortunately, the model was unable to predict or duplicate the results they saw in their clinical experiments.

Eventually, the researchers came to suspect that the memorability of certain words was linked to the frequency with which the brain used them as semantic links between other memories, making them often-visited hubs in individuals's memory networks, and therefore places the brain jumped to early and often when retrieving memories. This idea was supported by observed activity in participants' anterior temporal lobe, a language center.

In epilepsy patients, these words were so frequently recalled that subjects often shouted them out even when they were incorrect responses to word-pair inquiries.

Seek, find

Modern search engines no longer simply look for raw words when resolving an inquiry: They also look for semantic — contextual and meaning — connections so that the results they present may better anticipate what it is you're looking for. Xie suggests something similar may be happening in the brain: "You know when you type words into a search engine, and it shows you a list of highly relevant guesses? It feels like the search engine is reading your mind. Well, our results suggest that the brains of the subjects in this study did something similar when they tried to recall a paired word, and we think that this may happen when we remember many of our past experiences."

He also notes that it may one day be possible to leverage individuals' apparently wired-in knowledge of their language as a fixed point against which to assess the health of their memory and brain.

Videos

Does conscious AI deserve rights?

If machines develop consciousness, or if we manage to give it to them, the human-robot dynamic will forever be different.

Scroll down to load more…
Quantcast