40 Years of Government Nutrition Data May Be Flawed

Americans severely under-report how much food they eat, and this has affected decades of nutrition data. 

40 Years of Government Nutrition Data May Be Flawed

For forty years, the CDC's National Health and Nutrition Examination Survey (NHANES) has collected data on the caloric intake of Americans, answering the simple and important question of how much food we eat. This research has in turn been used to instruct public health policy. NHANES is actually the basis for national standards of height, weight, and blood pressure, and its findings are often used to develop programs in the public battle against obesity.

But there's just one "tiny" problem. According to an analysis conducted by exercise scientist Edward Archer at the University of South Carolina, NHANES is very likely invalid. And it's for a simple reason that almost anybody could point out: All of the data it collects on caloric intake is self-reported. 

Try to remember precisely what you ate over the past twenty-four hours and you'll see why this is a problem. People aren't only inept at estimating how many calories are in the foods they eat, they're also bad at recalling what they consumed and when.

With this in mind, Archer performed calculations merely to gauge if NHANES' data is physiologically plausible. In 1991, a team of physiologists determined that average, free-living individuals must consume at minimum at least 35% more calories than their basal metabolic rate (BMR) -- the amount of calories they expend resting -- in order to maintain their weight and health. This accounts for the energy people need to perform everyday activities, from just walking around, to playing sports, to gardening, etc. Archer used a well-established equation to estimate the BMR of individuals in the NHANES study, multiplied those values by 1.35, and compared them to the self-reported energy intakes in NHANES. What did that comparison yield? The majority of respondents, totaling 28,993 men and 34,369 women, reported eating less calories than even the bare minimum necessary to survive! 

Judging by how much Americans' waistlines have been infamously expanding, the respondents' eating estimations are obviously wrong. To Archer, it reinforces what previous research has clearly shown: Americans severely under-report how much food they eat, and this has affected decades of nutrition data. 

As Archer told me, one possible fix is to replace self-reporting with more empirical methods of determining caloric intake. The doubly labeled water technique, which uses well-established knowledge of carbon dioxide metabolism to calculate how much energy living subjects expend, could be adapted for use in NHANES and other federally funded health studies, he says. Doubly labeled water is considered a key biomarker for long-term energy intake.   

Archer, a former college football and professional polo player, exudes enthusiasm. He believes that science can truly help people live healthy and productive lives, but is dismayed that public health research consistently relies on imprecise methodology. Determined to change that, Archer hopes that his current study will impress upon people that the status quo of self-reporting isn't working. 

"The nation's major surveillance tool for studying the relationships between nutrition and health is not valid. It is time to stop spending tens of millions of health research dollars collecting invalid data and find more accurate measures," he said.

Though the study was just published to PLoS ONE on Wednesday, Archer is already receiving flack. Some dissenters question his calculations, which certainly aren't completely precise considering he obviously couldn't measure each subject's metabolism or energy intake. Others insist that self-reporting is simply the only viable option. Critics also point to the fact that his research is funded by Coca-Cola, a fact I queried him about. Archer explained that it's an unrestricted research grant. In other words, the soft drink maker contractually has no input or say in what he researches or publishes.

But more important than the specifics of Archer's study is the message it shouts. Self-reports of personal health and food intake are utterly inaccurate, and if we are ever to get a clear picture of the obesity epidemic and how to solve it, we need to start by collecting credible data.

Source: Archer E, Hand GA, Blair SN (2013) Validity of U.S. Nutritional Surveillance: National Health and Nutrition Examination Survey Caloric Energy Intake Data, 1971-2010. PLoS ONE 8(10): e76632. doi:10.1371/journal.pone.0076632

(Image: Scale & Tape Measure via Shutterstock)

Live on Thursday: Learn innovation with 3-star Michelin chef Dominique Crenn

Dominique Crenn, the only female chef in America with three Michelin stars, joins Big Think Live this Thursday at 1pm ET.

Big Think LIVE

Add event to your calendar

AppleGoogleOffice 365OutlookOutlook.comYahoo

Keep reading Show less

Physicists solve a 140-year-old mystery

Scientists discover the inner workings of an effect that will lead to a new generation of devices.

Carrier-resolved photo-Hall effect.

Credit: IBM
Surprising Science
  • Researchers discover a method of extracting previously unavailable information from superconductors.
  • The study builds on a 19th-century discovery by physicist Edward Hall.
  • The research promises to lead to a new generation of semiconductor materials and devices.
Keep reading Show less

Does forgetting a name or word mean that I have dementia?

The number of people with dementia is expected to triple by 2060.

Photo by Connor Wang on Unsplash
Mind & Brain
The number of cases of dementia in the U.S. is rising as baby boomers age, raising questions for boomers themselves and also for their families, caregivers and society.
Keep reading Show less

New Hubble images add to the dark matter puzzle

The images and our best computer models don't agree.

Surprising Science
  • Scientists can detect the gravitational effects of invisible dark matter.
  • Dark matter causes visual distortions of what's behind it.
  • The greater the distortion, the greater the amount of dark matter. Maybe.
  • Keep reading Show less
    Culture & Religion

    Did our early ancestors boil their food in hot springs?

    Scientists have found evidence of hot springs near sites where ancient hominids settled, long before the control of fire.

    Scroll down to load more…