Skip to main content.

Question the Findings: Robert Davis' five ways to query new studies

Question the Findings: Robert Davis' five ways to query new studies

Picture of Angilee Shah

Robert Davis, Ph.D., M.P.H. is on a mission: Reporters need to put on their skeptics' hats when they report on the latest and greatest in medical research.

The author of The Healthy Skeptic: Cutting Through the Hype About Your Health, Davis is a professor at Emory University's Rollins School of Public Health and the president of the health video company Everwell. He also has experience as a journalist on deadline as a television producer at PBS and CNN, an editor at WebMD and columnist at The Wall Street Journal.

"It's not to say that the tempting stories about miraculous technologies and saving lives are bad and not helping people," Davis said, "but we need to be skeptical about it."

Robert Davis
Robert Davis explains why it is so important to scrutinize press releases:

For the reporter on deadline, he offers five ways to scrutinize new studies and the press releases that hype them.

1. Research: "Clearly not all research is created equal, but often when we read about health, research is shown this way," said Davis. Reporters need to pay close attention to different types of studies and how relevant they actually are to consumers. It is important to understand and explain the relevance and credibility of different research strategies, he said. Davis' basic hierarchy runs from test-tube research as the least credible to randomized clinical trials as the most. 

2. Numbers: Put numbers in perspective by using absolute numbers. He compares numbers in studies to sales in department stores; even if you know an item is 50% off, you need to know the actual price. Numbers and statistics about prevalence should be questioned. Where did the information come from?

3. Conflicts and Biases: "There is a tendency to put doctors and scientists on a pedestal," Davis said. While there is not deception and fraud in most research, reporters need to be aware of who is funding research and what researchers stakes are in the results of their own studies. Simple web searches and scrutiny of institutions' website can turn up a lot of information about funders, doctors' investments and potential conflicts of interest.

4. Costs, Risks, Unknowns: Press releases often tell you more about the benefits of new drugs without telling as much about drawbacks and side effects. "The truth is there are very few penicillins," he said. With new devices, it is important to pay attention to more than just exciting technology. Ask about costs, effectiveness compared to older devices, and whether or not it is appropriate for everyone. Do the benefits outweigh the downsides? There are, for example, potential harms in mammography and it is important for reporters to make this clear.

5. The Big Picture: Research is not discrete. Findings are part of a body of work that reporters should understand in order to put individual studies in context.

 

Leave A Comment

Announcements

The pandemic has thrown into brutal relief the extent to which the U.S. health care system produces worse outcomes for patients of color. And yet there has been scant focus on one of the biggest drivers of structural racism in health care: How doctors and hospitals are paid. In this webinar, we’ll highlight the ways in which the health care system’s focus on money and good grades is shortchanging the health of communities of color. Sign-up here!

U.S. children and teens have struggled with increasing rates of depression, anxiety and suicidal behavior for much of the past decade. Join us as we explore the systemic causes and policy failures that have accelerated the crisis and its inequitable impact, as well as promising community-driven approaches and evidence-based practices. The webinar will provide fresh ideas for reporting on the mental health of youth and investigating the systems and services. Sign-up here!

The USC Center for Health Journalism at the Annenberg School for Communication and Journalism is seeking two Engagement Editors and a social media consultant to join its team. Learn more about the positions and apply.

CONNECT WITH THE COMMUNITY

Follow Us

Facebook


Twitter

CHJ Icon
ReportingHealth