How MIT's VR environment is saving drones from crashing to death

Sales of drones are clocking in around $200 million and doubling each year. Which means there's a lot of testing to be done.

How MIT's VR environment is saving drones from crashing to death
Bridge roads in Riga city 360 VR Drone picture for virtual reality panorama. (Shutterstock)


Drones, or unmanned vehicles that fly through the air, are used by civilians and the military alike. While the military uses drones to get to areas that are too difficult or risky for humans, commercially drones are used for photography, research, and even racing.

According to Gartner, a research firm, drone sales grew 60% from 2016 to 2017 to $2.2 million, with revenue up 36% to almost $4.5 billion. With estimates of U.S. drone sales doubling year over year, millions of hobbyist drones are now in homes. Per year, sales of drones are clocking in around $200 million, and an average drone from DJI, the leading commercial drone manufacturer, is between $500 to $1,000.

Drones are essential to many fields, such as businesses, the government, and certain industries, like agriculture. Important fields with promising drone-usage include:

  • Photographing

  • Journalism

  • Film

  • Express delivery (think Amazon)

  • Supplying necessities in disaster zones

  • Search and Rescue (thermal sensor drones)

  • Mapping of inaccessible terrains

  • Safety inspections

  • Crops (monitoring, delivery of resources, etc)

  • Cargo transport

  • Law enforcement, like border patrol

  • Strom tracking

With so much money being spent on the development of drones, testing their safety, abilities, and durability are paramount to the industry’s success. After all, with a $500+ price tag, replacing them isn’t cheap. Due to the cost of repairing and replacing drones, a better way to train autonomous drones was needed. That’s where MIT comes in - with a VR training system named “Flight Goggles.”

The VR environment creates indoor obstacles for the drones to fly around, without actually needing to have those obstacles be indoors - the testing facility can remain empty, while the drone sees “real” obstacles. Additional benefits of “Flight Goggles” are endless, as virtual testing facilities in which any environment or condition can be subbed in for the drones to train. 

“We think this is a game-changer in the development of drone technology, for drones that go fast,” Associate Professor Sertac Karaman said in an MIT blog post. “If anything, the system can make autonomous vehicles more responsive, faster, and more efficient.”

Currently, if a researcher wants to fly an autonomous drone, they must set up in a large testing facility in which physical obstacles, like doors and windows, must be brought in, as well as large nets to catch falling drones. When they do crash (and they do) the cost of the project and the development timeline both increase, due to repairs and replacements.

“The moment you want to do high-throughput computing and go fast, even the slightest changes you make to its environment will cause the drone to crash,” said Karaman. “You can’t learn in that environment. If you want to push boundaries on how fast you can go and compute, you need some sort of virtual-reality environment.”

Researchers use a motion capture system, electronics, and an image rendering program to transmit the images to the drone. The images - which are processed by the drone at about 90 frames per second - are all thanks to circuit boards and the VR program the drone operates within.

“The drone will be flying in an empty room, but will be ‘hallucinating’ a completely different environment, and will learn in that environment,” Karaman explains.

During the course of 10 test flights using the VR program, the drone (which files at around 5 miles per hour) successfully flew through a virtual window 361 times, only crashing three times - which doesn’t impact the development of costs. And as the window was virtual, nobody was hurt by glass. So it's a win-win for enthusiasts, researchers, professionals, and everyone in between. 

3,000-pound Triceratops skull unearthed in South Dakota

"You dream about these kinds of moments when you're a kid," said lead paleontologist David Schmidt.

Excavation of a triceratops skull in South Dakota.

Credit: David Schmidt / Westminster College
Surprising Science
  • The triceratops skull was first discovered in 2019, but was excavated over the summer of 2020.
  • It was discovered in the South Dakota Badlands, an area where the Triceratops roamed some 66 million years ago.
  • Studying dinosaurs helps scientists better understand the evolution of all life on Earth.
Keep reading Show less

The cost of world peace? It's much less than the price of war

The world's 10 most affected countries are spending up to 59% of their GDP on the effects of violence.

Mario Tama/Getty Images
Politics & Current Affairs
  • Conflict and violence cost the world more than $14 trillion a year.
  • That's the equivalent of $5 a day for every person on the planet.
  • Research shows that peace brings prosperity, lower inflation and more jobs.
  • Just a 2% reduction in conflict would free up as much money as the global aid budget.
  • Report urges governments to improve peacefulness, especially amid COVID-19.
Keep reading Show less

The evolution of modern rainforests began with the dinosaur-killing asteroid

The lush biodiversity of South America's rainforests is rooted in one of the most cataclysmic events that ever struck Earth.

Velociraptor Dinosaur in the Rainforest

meen_na via Adobe Stock
Surprising Science
  • One especially mysterious thing about the asteroid impact, which killed the dinosaurs, is how it transformed Earth's tropical rainforests.
  • A recent study analyzed ancient fossils collected in modern-day Colombia to determine how tropical rainforests changed after the bolide impact.
  • The results highlight how nature is able to recover from cataclysmic events, though it may take millions of years.
Keep reading Show less
Quantcast