Exaggerated claims were most often traced to the press releases at the scientist's institutions
Specifically, if the article title declared that the study involved mice then 46.2% of news headlines did also. If the title did not mention mice, then only 10.4% did. This is a very large difference that traces directly back to the published science article itself.
While this is only one factor affecting the accuracy of science news reporting, it highlights that scientists themselves and journal editors, take significant responsibility for the quality of reporting about their own research. This goes beyond crafting the title of the article. Prior research has also found that when researchers exaggerate their own research in the abstract or discussion of their paper this is likely to translate to exaggerated reporting.
In another study, exaggerated claims were most often traced to the press releases at the scientist's institutions: "40% of the press releases contained exaggerated advice, 33% contained exaggerated causal claims, and 36% contained exaggerated inference to humans from animal research. When press releases contained such exaggeration, 58%, 81%, and 86% of news stories, respectively, contained similar exaggeration, compared with exaggeration rates of 17%, 18%, i and 10% in news when the press releases were not exaggerated." This is a huge difference. (9)
All of this does not mean that medical studies are of no value or that health reports are always wrong. It simple serves as a warning that science is fluid, not static or absolute. It does suggest that every time you see a headline claiming that X causes cancer of that Y prevents it, some skepticism might be in order.
References
1. Susan Goldhaber, "The lasting impacts of scientific fraud," acsh.org/news, February 13, 2024
2. Edward J. Calabrese, “Cancer risk assessment: it's wretched history and what it means for public health,” Journal of Occupational and Environmental Hygiene,” March 7, 2024
3. Lawrence Solomon, “Radiation's benefits,” Financial Post, September 2010
4. T. D. Luckey, Radiation Hormesis, Boca Raton, CRC Press, 1991
5. Maurice Tubiana et al., “The linear-no-threshold relationship is inconsistent with radiation biologic and experimental data,” Radiology, 251, 6, 2009
6. Jay Lehr, “Low-level radiation benefits health,” Environment & Climate News, August 2011
7. Steven Novella, "The causes of bad science reporting," sciencebasedmedicine.org, June 16, 2021
8. Marcia Triunfol and Fabio C. Gouveia, "What's not in the news headlines or titles of Alzheimer disease articles?, " PLOS Biology, June 15, 2021
9. Petroc Sumner et al, "The association between exaggeration in health related science news and academic press releases: retrospective observational study," British Medical Journal, 2014;349; g7015