Concern trolling: the fear-based tactic that derails progress, from AI to biotech

“What’s the worst that could happen?” This innocent-seeming question is normally uttered when someone is venturing into unknown territory, with the implication being that sure, there might be a chance of some sort of negative outcome, but the probability of a catastrophically bad outcome is exceedingly small. Nothing ventured, nothing gained, after all.

But there’s a bit of a dark side to asking that question, as the capacity for the human imagination to catastrophize seems to be unbounded. If the consequences we can imagine are bad enough, even if the probability of such an outcome is low, then in our head, the risk-reward equation tips toward the “not worth it” side. This is true even when the imagined catastrophe is completely detached from reality.

Recently, many prominent signatories issued an Open Letter from Future of Life Institute, which warned about the dangers of the unchecked development of artificial intelligence, and immediately called for a 6-month pause into the type of deep-learning AI research that’s brought us technologies like ChatGPT, Stable Diffusion, and Dall-E. They assert that “[p]owerful AI systems should be developed only once we are confident that their effects will be positive and their risks will be manageable.”

Only, this is not a reasonable warning at all; it’s an unreasonable recommendation that totally skirts the true problem we need to reckon with: the unethical ways that humans leverage new technologies and novel resources of any type to exploit one another for personal gain. This type of behavior is not an accident, but rather a deliberate strategy that’s taken off in the 21st century and, in particular, on the internet: concern trolling. Here’s how you can spot it, and what you should focus on instead.

Quickly typed out on October 6, 2022, Ethan Siegel’s four rules of persuasion for science communicators (and more) was turned into a meme by Twitter user @Tom_Ruen.

Concern trolling is basically when you pretend to care about an issue in order to undermine and derail any measures that would be taken to address the actual, underlying problem that’s affecting society. Instead, it’s a tactic that’s used to:

• trigger infighting among the groups/people who are actively working on the true problem,
• reframe the argument to try and take power away from an actual, effective movement,
• and to flood the public discussion with noise and distraction, often with tremendous success.

This is a particularly fruitful tactic when the seeds of fear are already present, as it’s extremely easy to take an already fearful (sometimes, justifiably so) group and point them toward an imagined boogeyman, causing them to attack and fixate on a completely extraneous, possibly even non-existent, problem instead.

A child receives a polio vaccine drop in Gwalior, India, to reduce the risk of contracting and spreading the disease. Misinformation and anti-vaccine propaganda, spurred on largely by concern trolls and untrue information, continues to drive vaccine hesitancy and amplify the spread of preventable diseases.

In this particular case, the open letter mentions problems that have been brewing for a long time in our society, independently of LLMs and AI, such as:

• Should we let machines flood our information channels with propaganda and untruth?
• Should we automate away all the jobs, including the fulfilling ones?
• Should we develop nonhuman minds that might eventually outnumber, outsmart, obsolete, and replace us?
• Should we risk losing control of our civilization?

But “pausing” this type of research will do nothing to stop or slow these problems. We’ve already decided, on all four of these issues, that “we don’t care” is the answer. What we’re going to do about it remains not only unanswered, but completely independent of what the power or capabilities of AI systems actually are. Humans are going to do this to one another anyway, and are already doing so. The issues raised, although real, are in no way related to the development of this novel technology.

The human brain is generally regarded as a marvel, with an estimated 86 billion neurons and some 7000 times as many connections between neurons in each adult brain. While many are projecting that there will be more connections and “neuron equivalents” to artificial intelligence-powered machines in the near future, the human brain is composed of a lot more than neurons (including enormous numbers of glial cells), and its complexity is not yet fully understood.

In fact, the big problem of concern trolling is this: if you get enough people to agree with the concern troll and you wind up actually empowering them, what always happens is that ineffective regulations get put into place. If the concern trolls win, whatever they’re “trolling against” gets slowed down or stopped entirely, but the actual, underlying problem remains and has even less of a chance of getting legitimately addressed. If you think that “pausing” this type of artificial intelligence research will do anything to address:

• the problem of misinformation, propaganda, untruth, and disinformation flooding our media,
• the problem of job loss due to automation,
• the problem of computers making humans obsolete for ever-increasing numbers of complex tasks,
• or the problem of civilization being out of the control of reasonable humans,

I would strongly argue that you have lost your connection with reality.

All of these problems already exist, and have existed independently of any type of general or generative artificial intelligence. These are problems for human civilizations and governments to either reckon with or not. So far, we’ve abdicated those responsibilities on a global scale with an extreme laissez-faire attitude. “Pausing” AI research will only harm AI research; it will not cause a global rethink of these actual, real issues.

As they orbit the Sun, comets and asteroids typically break up over time, with debris between the chunks along the path of the orbit getting stretched out to create debris streams. These streams cause meteor showers when the Earth passes through that debris stream. This image taken by Spitzer along a comet’s path shows small fragments outgassing, but also shows the main debris stream that gives rise to the meteor showers that occur in our Solar System.

There are a virtually unlimited number of examples where concern trolling has been an extraordinarily effective tactic in stalling or completely preventing meaningful action from being taken, allowing very real problems to persist and worsen while simultaneously weakening meaningful attempts to address them.

For example, the largest city in the United States that doesn’t have fluoridated drinking water — in a nation without universal dental care — is Portland, OR. In 2013, a new attempt was made to add fluoride to the drinking water, and a general election was held in May of 2013 for the citizens to vote on the issue.

Instead of a health-and-science-based look at the issues, however, anti-fluoride advocates engaged in concern trolling about the health risks and detriments of fluoride. They warned that their pristine water was going to be polluted with fluoride. That people were going to be “mass medicated” without consent. And that fluoride was a poisonous chemical. All over Portland, signs began appearing that proclaimed “Vote No! Fluoridation Chemicals.” In the end, the campaign won public opinion over by a 3:2 margin, despite their claims being scientifically baseless. As a result, Portland still has, when adjusted for socioeconomic demographics and income, children with weaker enamel and 40% more cavities than children in other major cities that do have fluoridated drinking water. The underlying public health problem continues to this day and has not been addressed in any meaningful way over the past decade.

Although there are negative effects associated with getting too much fluoride, there are also negative effects on health and development associated with getting too little fluoride. Despite continued warning by the ADA, dentists, and hygienists all across areas with unfluoridated drinking water in the United States, many communities have resisted adding it, dubiously citing health concerns that only arise with extraordinarily large fluoride concentrations.

A similar story of concern trolling has led to a prolonged epidemic of Vitamin A deficiency in a number of countries. Millions of children across the world suffer from this deficiency, as their rice-rich diets — where conventional rice contains almost no Vitamin A — do not give them nearly enough of this necessary nutrient. Without enough Vitamin A, your risk of blindness and disease susceptibility increases tremendously; according to Helen Keller International, 670,000 children die and 350,000 children go blind each year from Vitamin A deficiency.

To combat this, Golden Rice was developed by scientists. By adding extra genes to the rice plant (a genetic modification), the plant began producing beta-carotene, which humans convert into Vitamin A. As little as 2 cups a day of Golden Rice would provide 100% of a full-grown adult’s Vitamin A needs.

In 2013 in the Philippines, where 1.7 million children suffer from Vitamin A deficiency, driven by a concern troll campaign that targeted all genetic modifications (i.e., anti-GMO propaganda), an entire field of Golden Rice was destroyed by a group of 400 protestors. This was part of a trial plot that was about to be submitted for evaluation; the protestors were confident that they had saved their nation from the horrors of GMOs. Instead of Golden Rice beginning commercial production in 2014, as was previously planned, this delayed the onset of commercial production until 2021, leading to an extra 7 years of unnecessary, preventable instances of blindness, disease, and death among Filipino children.

Grains of the genetically engineered Golden Rice (right), compared to the Vitamin A-deficient white rice (left). Hundreds of thousands of children per year, worldwide, on primarily rice diets, go blind from lack of Vitamin A, with even greater numbers dying from it outright. Golden Rice could cure that problem. Scientists, but also many other professionals in public health, marketing, politics, and more are required to turn this scientific solution into a practical solution.

Concern trolling is often used, as well, to gain fame, power, influence, and prominence for particular individuals. All you have to do is:

• take something that people don’t know very much about,
• feed whatever fears they may have (particularly if it’s about an imagined harm to children),
• conflate those fears with an actual, real problem (especially a health problem),

and you’re practically guaranteed to gather an army of followers to your side.

Health quacks like Mehmet Oz and Joe Mercola have built large empires by doing exactly this with a variety of issues, while getting rich off of selling snake-oil-esque “miracle cures” that have no scientific backing: the same products sold by GOOP and Alex Jones. Robert Kennedy Jr. has done this by sowing doubts about the safety and efficacy of vaccines and promoting a link to autism, helping spark a widespread (but scientifically unfounded) anti-vaccine movement. Dr. Joel Moskowitz has done this by blaming a variety of cancers on radio frequency (i.e., WiFi) radiation, despite absolutely no evidence supporting that link.

The problem is that there are real problems that people are facing: developmental disorders, diseases, environmental pollution, neurodivergences, etc. But instead of focusing their efforts on understanding and combating these problems, the act of concern trolling instead diverts attention and money toward the imagined, phantasmal causes of these charlatans.

Despite a variety of conspiratorial claims to the contrary, 5G cell towers, which this previous 4G tower in Orem, Utah, was being upgraded to at the time this 2021 photo was taken, pose no danger to human or animal health. In particular, they do not cause cancer, mind control, or spread COVID-19. A few years ago, this (now-obvious) conspiracy theory was taken seriously by millions of advocates across the planet, and no doubt the next upgrade, to the 6G standard, will bring about the same fundamentally anti-science claims.

But perhaps the biggest examples of concern trolling are when politically motivated actors spread misinformation to sow doubt and dissent around issues that have very robust scientific and health answers. Think about it; there’s an overwhelming suite of evidence that:

• global warming is real, happening, and driven by human-caused emissions of CO2,
• the #1 threat to transgender individuals’ mental health is unsupportive parents,
• pandemics are caused by human-animal contact, and particularly by human encroachment on previously wild spaces,
• and that gun violence is the leading cause of death among children in the United States.

But much of the public discourse around these issues is dominated by concern trolls. Many bad actors deliberately sow doubt among the general public about climate change, where none exists from a scientific perspective. By framing the healthcare rights of transgender individuals as a partisan or ideological debate, concern trolls are preventing some individuals from receiving proper, perhaps life-saving healthcare. An obsession over a conspiracy that the COVID pandemic was created from a genetically modified virus in Wuhan has hindered pandemic prevention efforts.

Additionally, many claim to want to “protect children” by whipping up fear over imaginary issues, banning books, regulating who can read to children, and preventing members of the LGBTQ community from interacting with kids. All this, while the actual problems of child sex abuse and gun violence against children go unaddressed.

The central idea of the lab leak hypothesis, that the virus spilled over from the Wuhan Institute of Virology, is only possible if the virus from which SARS-CoV-2 originated was actually ever inside the institute itself. If the virus originated naturally, with parts of it found in animals that were located in a wild population in Laos, which genetic sequencing uncovered in 2021 indicates, the lab leak hypothesis is ruled out as a possibility. You cannot create something through gain-of-function research that will have an identical genetic code to something that came about in the wild through natural processes such as recombination.

There’s a particular irony, returning to the letter penned by the Future of Life Institute, that its most prominent signatory was Elon Musk. Since the first 2019 launch of brighter-than-anticipated Starlink satellites, astronomers have asked for a pause in their launch and deployment until they met the necessary specifications, as they’ve unleashed a new, unprecedented type of pollution into the night sky, with quantifiably negative global effects on all of humanity. Musk’s Tesla has been found guilty, in court, of several labor law violations, and has been caught staging — and then untruthfully advertising — an autonomous self-driving capability that does not exist, directly leading to accidents and deaths.

Remember, the crux of the argument that the open letter made, specifically about AI but generally applicable to any technology, was that technological development and applications should occur:

“only once we are confident that their effects will be positive and their risks will be manageable”

When someone openly advocates one line of reasoning for regulations that apply to their own technologies and another, contradictory one for the technologies of others, the hypocrisy should rattle you to your core.

The atmospheric re-entry of a satellite, such as the ATV-1 satellite shown here, will lead to the majority or even the totality of the satellite’s composition being deposited into various layers of Earth’s atmosphere Although the speeds associated with satellite re-entry are tremendous, this is a completely natural process that in no way indicates an unearthly or supernatural intervention.

The sober truth is that there are real societal concerns with the arrival of any new technology, but this is not because the technology itself is problematic. Instead, the problem is how human beings will use it, unethically, for their own gain and to harm others. If we genuinely hope to build a better society, those are the guardrails that need to be set up: against those who would use technology for the exploitation of others, not against the technology itself.

The tactic of concern trolling — and the diversion of resources from where they should be going to truly address an issue — is yet another front that the war against misinformation must be fought on. By tapping into our fears and outrage, this strategy often amplifies societal schisms and foists further burdens onto those who advocate for optimal science-based and health-based outcomes. From AI to biotech to disease prevention to global warming to children’s health and everywhere else, we must combat this divisive behavior and fight it with the one weapon that’s always at our disposal: the honest and complete truth.