The surveillance technology that will watch us all, all the time

Wide Angle Motion Imagery (WAMI) is a surveillance game-changer. And it's here.

An owl-like unmanned aerial vehicle on display at the Army 2019 International Military Technical Forum at Patriot Park.

Photo by Stanislav Krasilnikov\TASS via Getty Images
  • In his new book, Eyes in the Sky, Arthur Holland Michel details the evolution of aerial surveillance technology.
  • Cameras aboard drones can monitor the entirety of 50 square kilometers for hours without refueling.
  • New aerial technologies will create the privacy fights of the future.

That fiction inspires reality is nothing new, yet the depth of this process can be startling—and unnerving. It's hard to imagine Enemy of the State, a 1998 drama-mystery in which Will Smith and Gene Hackman battle a corrupt NSA official played by Jon Voight, would inspire the revolution in aerial surveillance technology currently happening around the world. Yet as Arthur Holland Michel reveals in his new book, that's exactly what happened after a San Francisco-based researcher saw the movie.

For Michel, the founder and co-director of the Center for the Study of the Drone at Bard College, Eyes in the Sky: The Secret Rise of Gorgon Stare and How It Will Watch Us All is the culmination of nearly a decade-long research project into the burgeoning business of Wide Angle Motion Imagery (WAMI). To put this into perspective, here's one project Michel touches upon, dating back to August 2009:

"In its final form, ARGUS had 1,854,296,064 pixels, enough imaging power to spot an object six inches wide from an altitude of 25,000 feet in a frame twice the width of Manhattan."

Though the term "Orwellian" easily applies to such a technology, Michel's illuminating reporting touches something deeper. Numerous American cities have already been surveilled using these god-like cameras, including Gorgon Stare, a camera-enabled drone that can track individuals over a 50-square kilometer radius from 20,000 feet.

Here's the real rub: the feature that allows users to pinch and zoom on Instagram is similar to what WAMI allows. Anything within those 50-square kilometers is now under the microscope. If this sounds like some futuristic tech, think again: Derivations of this camera system have been tested in numerous American cities.

I recently chatted with Michel about his book. Though he ultimately feels hopeful humans will be benevolent with this technology, he recognizes the dangers it poses in the hands of authoritarian regimes (as well as scorned lovers and voyeurs). The time for legislating drones is now, as these cameras are no longer down the road. They're here.

The future of surveillance technology

When did you first decide to become a horror writer?

I fell into it when I was a student at Bard College. I had this crazy idea to start a research institute that would study drones in all their many forms. That project really took on a life of its own. By the time I graduated in May 2013, we had enough traction that I started working for the college right away. If you study drones, you get to think about and look at a whole range of very nightmarish technologies. The aerial surveillance technologies that the book looks at were particularly frightening to me. I felt like something needed to be written about them.

You write that everyone you talk to who's involved thinks that they're doing it for good reason. Technology itself isn't good or bad, but it's how we use it, and humans are natural voyeurs. It seems so easy and exploitable.

Imagine you have the superpower to watch an entire city simultaneously. Initially you will, like any superhero, use it for very noble ends. You will track down violent criminals. You will bring murderers to justice. But as you're doing all that, you might also notice that there are lesser evil people committing lesser crimes. Maybe someone's illegally dumping garbage in an area where they shouldn't and you think, "I have this capability, I might as well track them down and bring them to justice too." As you work your way down the order of criminal acts, you soon start finding yourself rubbing up against areas where the law isn't so clear. A peaceful protest in my eyes might be a riotous assemblage of thugs in the eyes of somebody else.

Say there is a big public protest. With this camera you can follow thousands of protesters back to their homes. Now you have a list of the home addresses of all the people involved in a political movement. If on their way home you witness them committing some crime—breaking a traffic regulation or frequenting a location that is known to be involved in the drug trade—you can use that surveillance data against them to essentially shut them up. That's why we have laws that prevent the use of surveillance technologies because it is human instinct to abuse them. That's why we need controls.

A drone photo shows the crowd sunbathing at Florya Gunes Beach during the third day of Eid Al-Adha (Feast of the Sacrifice) in Istanbul, Turkey on August 13, 2019.

Photo: Muhammed Enes Yildirim/Anadolu Agency via Getty Images

You watched a boy get shot in Brooklyn who could have found justice if such a technology was in use. How is the public grappling with the desire for justice and retribution combined with the fear of privacy issues?

It is one of the questions of our time. If we have the capability to bring a violent criminal to justice, then we have a responsibility to use that capability. I saw the violent shooting of this 19-year-old boy. Fortunately he didn't die, but I don't feel particularly safe knowing that his assailants are still roaming free. If that technology had been available at the time, a really significant part of me would have wanted it to be used.

Are there ways of finding a balance? I believe that there are. We found that balance in the past. Consider wiretapping technology. When that technology was first introduced in the early 20th century, there were no controls, and so police were using it on whoever they felt like listening to. Once controls were imposed, there were a set of really strict requirements, namely that you need a warrant for probable cause as deemed by a judge with the court order to listen in on a private conversation.

I live in Los Angeles, where marijuana is recreational. On a federal level, it's not legal. So there's this disparity in the law. A lot of companies are using CBD, yet they're concerned because it's not federally legal. Have you seen any tension between, say, San Francisco, where the city government is implementing rules on facial recognition and aerial surveillance, and the federal government, which could disregard such rules?

It's a fantastic question because as I point out in the book, these conversations are not happening at a federal level. As far as I know, there has only been one congressional document that speaks to the potential dangers of wide area airborne surveillance. That's a problem, because there are a lot of federal agencies that are very eager to use this technology. The FBI and Department of Homeland Security have extensive aerial surveillance programs.

So far, we have not to my knowledge seen much outright tension between the local level and the state level, though a lot of these operations and the conversations that happen around them are shrouded in secrecy. There is a good chance that were there any tension or pushback from the local level, we would not hear about it. If Congress and federal agencies step up to the task of actually controlling these technologies, then the state level and the federal level and the local level may see more eye-to-eye on these measures.

Gorgon Stare in Baltimore

Your book is heavily rooted in the U.S. Other governments could be much less likely to care about legislation and much more likely to monitor their population at all times.

Absolutely. That's why the proliferation of this technology is particularly troubling. We know, for example, that Chinese research institutions have invested considerable resources in developing certain capabilities for this technology that has nothing to do with building cameras, but with building algorithms to analyze the data from those cameras.

A whole city as viewed through a camera is a lot of information for human eyes to process. If you can process that information with a really smart computer visions system, then the surveillance becomes activated and you can see everything at once. It's also particularly troubling because we know that China has an abysmal record when it comes to civil liberties. We know that it has an extensive program of surveillance in some of the western provinces where minorities live. With a camera like the cameras that I discuss in the book, they'd be able to do all sorts of unthinkable things.

Did you find any problems in terms of the technology itself or the people behind it profiling others?

There is a tremendous amount of evidence that suggests that all sorts of different algorithms and automated analysis systems in use today are biased. We know that's the case of facial recognition systems; we also know that it is likely to be possible in algorithms that do predictive policing based on historical crime data for particular neighborhoods. There's also the reliability element. When computers are analyzing something as subtle as a set of potentially suspicious behaviors, they're likely to make mistakes. It's not always clear to the human operators who are working with that automated system when it will make a mistake and when it won't. That makes the relationship between the computer and the human very troublesome.

Since aerial space is public property, if someone films me in a backyard, it isn't their fault for filming but my fault for not "protecting myself." Do you think we'll see public mobilization against these technologies?

I'm optimistic. Just as we are seeing, albeit slowly, a mobilization against some of the large internet firms because of all the data that they collect on us, people are starting to realize that the current regulations in place for protecting our privacy are not quite up to the task of regulating all the tools that are now at our disposal. You point to one very good example of that, which is that we do not, as per standing U.S. privacy law and precedent, have any expectation of privacy in any place that is visible from the sky. It doesn't matter whether you're in a backyard or in a secluded neighborhood surrounded by trees, if you're visible from above, anything is fair game.

That made sense at a time when the only aerial surveillance technologies in existence were expensive, loud, rare police helicopters that could only be used very sparingly for high priority investigations and operations. Now things are very different because with these wide area surveillance technologies. A single aircraft flying so high that you may not even be able to spot it from the ground can be watching you in fine-grain detail. That's completely legal because in the eyes of the law that high altitude persistent surveillance airplane is no different from a low altitude helicopter. Whenever I tell someone that these technologies are completely legal, I always get a reaction.

On March 12, 2019, according to a report by the Stockholm International Peace Research Institute (SIPRI) of Sweden on March 11, China has broken through the traditional situation that the export of armed UAVs is dominated by the United States.

Photo: Long Wei / Barcroft Media via Getty Images

You make one prediction in a footnote that in 10 years we will have a third license plate on the roof of our cars so these cameras can track us. Do you have any other predictions?

That footnote is funny. It has gotten so much attention since the book came out. That really threw me off because I was writing about police departments following cars with aerial surveillance technologies not being able to see license plates. It just seems so obvious to me that we're going to have license plates on our roofs. Now that the book is out, many people have heard about it and seem to be pretty displeased by the prospect.

One of the predictions that I stand by is that whether or not every city in America will someday be watched by an all seeing eye in the sky. I believe that every city will be watched in some wide area way. Even if you don't have an airplane doing this type of surveillance, there are all kinds of other technologies that can track us wherever we go at all times of day. You could put the same types of cameras on the tops of buildings. You could apply tracking algorithms to CCTV cameras. You could use a dense network of license plate readers. All of these surveillance technologies operate on a similar principle, which is collect everything and then separate the wheat from the chaff. It's only when you collect everything that you can seek crimes that you previously did not know about.

It's a big data theory of surveillance. That's concerning because with the advent of automation, this data can be analyzed in all kinds of unimaginable ways. It can be analyzed to look for anomalies, because anomalies are considered suspicious and anomalies can lead us to crimes before they happen. We don't want to live in a society where every deviation from the norm is marked as suspicious.

--

Stay in touch with Derek on Twitter and Facebook.

A still from the film "We Became Fragments" by Luisa Conlon , Lacy Roberts and Hanna Miller, part of the Global Oneness Project library.

Photo: Luisa Conlon , Lacy Roberts and Hanna Miller / Global Oneness Project
Sponsored by Charles Koch Foundation
  • Stories are at the heart of learning, writes Cleary Vaughan-Lee, Executive Director for the Global Oneness Project. They have always challenged us to think beyond ourselves, expanding our experience and revealing deep truths.
  • Vaughan-Lee explains 6 ways that storytelling can foster empathy and deliver powerful learning experiences.
  • Global Oneness Project is a free library of stories—containing short documentaries, photo essays, and essays—that each contain a companion lesson plan and learning activities for students so they can expand their experience of the world.
Keep reading Show less

Four philosophers who realized they were completely wrong about things

Philosophers like to present their works as if everything before it was wrong. Sometimes, they even say they have ended the need for more philosophy. So, what happens when somebody realizes they were mistaken?

Sartre and Wittgenstein realize they were mistaken. (Getty Images)
Culture & Religion

Sometimes philosophers are wrong and admitting that you could be wrong is a big part of being a real philosopher. While most philosophers make minor adjustments to their arguments to correct for mistakes, others make large shifts in their thinking. Here, we have four philosophers who went back on what they said earlier in often radical ways. 

Keep reading Show less

New simulations show how supermassive black holes form

Researchers from Japan add a new wrinkle to a popular theory and set the stage for the formation of monstrous black holes.

Snapshot of new simulation of supermassive black-hole formation

Image source: Sunmyon Chon/National Institutes Of Natural Sciences, Japan
Surprising Science
  • A new theory takes the direct-collapse theory explaining the creation of supermassive black holes around which galaxies turn ones step further.
  • The advance is made possible by a super-powerful computer, ATERUI II.
  • The new theory is the first that accounts for the likely assortment of heavy elements in early-universe gas clouds.

It seems that pretty much every galaxy we see is spinning around a supermassive black hole. When we say "supermassive," we mean BIG: Each is about 100,000 to tens of billions times the mass of our Sun. Serving as the loci around which our galaxies twirl, they're clearly important to maintaining the universal structures we see. It would be nice to know how they form. We have a pretty good idea how normally-huge-but-not-massive black holes form, but as for the supermassive larger versions, not so much. It's a supermassive missing piece of the universe puzzle.

Now, in research published in Monthly Notices of the Astronomical Society, astrophysicists at Tohoku University in Japan reveal that they may have solved the riddle, supported by new computer simulations that show how supermassive black holes come to be.

The direct collapse theories

Glowing gas and dark dust within the Large Magellanic Cloud

Image source: ESA/Hubble and NASA

The favored theory about the birth of supermassive black holes up to now has been the "direct-collapse" theory. The theory proposes a solution to a cosmic riddle: Supermassive black holes seem to have been born a mere 690 million years after the Big Bang, not nearly long enough for the standard normal black hole genesis scenario to have played out, and on such a large scale. There are two versions of the direct-collapse theory.

One version proposes that if enough gas comes together in a supermassive gravitationally bound cloud, it can eventually collapse into a black hole, which, thanks the cosmic background-radiation-free nature of the very early universe, could then quickly pull in enough matter to go supermassive in a relatively short period of time.

According to astrophysicist Shantanu Basu of Western University in London, Ontario, this would only have been possible in the first 800 million years or so of the universe. "The black holes are formed over a duration of only about 150 million years and grow rapidly during this time," Basu told Live Science in the summer of 2019. "The ones that form in the early part of the 150-million-year time window can increase their mass by a factor of 10 thousand." Basu was lead author of research published last summer in Astrophysical Journal Letters that presented computer models showing this version of direct-collapse is possible.

Another version of the theory suggests that the giant gas cloud collapses into a supermassive star first, which then collapses into a black hole, which then — presumably again thanks to the state of the early universe — sucks up enough matter to go supermassive quickly.

There's a problem with either direct-collapse theory, however, beyond its relatively narrow time window. Previous models show it working only with pristine gas clouds comprised of hydrogen and helium. Other, heavier elements — carbon and oxygen, for example — break the models, causing the giant gas cloud to break up into smaller gas clouds that eventually form separate stars, end of story. No supermassive black hole, and not even a supermassive star for the second flavor of the direct-collapse theory.

A new model

ATERUI II

Image source: NAOJ

Japan's National Astronomical Observatory has a supercomputer named "ATERUI II" that was commissioned in 2018. The Tohoku University research team, led by postdoctoral fellow Sunmyon Chon, used ATERUI II to run high-resolution, 3D, long-term simulations to verify a new version of the direct-collapse idea that makes sense even with gas clouds containing heavy elements.

Chon and his team propose that, yes, supermassive gas clouds with heavy elements do break up into smaller gas clouds that wind up forming smaller stars. However, they assert that's not the end of the story.

The scientists say that post-explosion, there remains a tremendous inward pull toward the center of the ex-cloud that drags in all those smaller stars, eventually causing them to grow into a single supermassive star, 10,000 times larger than the Sun. This is a star big enough to produce the supermassive black holes we see when it finally collapses in on itself.

"This is the first time that we have shown the formation of such a large black hole precursor in clouds enriched in heavy-elements," says Chon, adding, "We believe that the giant star thus formed will continue to grow and evolve into a giant black hole."

Modeling the behavior of an expanded number of elements within the cloud while faithfully carrying forward those models through the violent breakup of the cloud and its aftermath requires such high computational overhead that only a computer as advanced as ATERUI II could pull off.

Being able to develop a theory that takes into account, for the first time, the likely complexity of early-universe gas clouds makes the Tohoku University idea the most complete, plausible explanation of the universe's mysterious supermassive black holes. Kazuyuki Omukai, also of Tohoku University says, "Our new model is able to explain the origin of more black holes than the previous studies, and this result leads to a unified understanding of the origin of supermassive black holes."

5 charts reveal key racial inequality gaps in the US

The inequalities impact everything from education to health.

ANGELA WEISS/AFP via Getty Images
Politics & Current Affairs

America is experiencing some of its most widespread civil unrest in years following the death of George Floyd.

Keep reading Show less
Scroll down to load more…