Article: Medical students are using a popular research tool to pump out misleading studies — Science.org

Chandelier

Senior Member (Voting Rights)

Medical students are using a popular research tool to pump out misleading studies​

Critics say TriNetX’s easy analyses of electronic medical records fuel quick-and-dirty publications from inexperienced authors

24 JUN 2026
BY FREDERIK JOELVING, RETRACTION WATCH


The rise mirrors recently reported trends seen in papers using publicly available health data sets, which are authored primarily by researchers in China. But TriNetX is only open to users at participating health care organizations, and most TriNetX papers come from authors at U.S. medical schools, often with a physician-in-training as lead author. Medical schools use TriNetX as a research training ground, and the resulting papers are a relatively easy way for medical students to boost their CVs before applying for residencies. “There is no substitute for learning this process than by doing it,” says Lisa Howley of the Association of American Medical Colleges (AAMC).

But the combination of inexperienced users and TriNetX’s push-button analysis tools can lead to shoddy publications, which often do not correct for potential biases that can make treatments appear more effective than they are. And because the data can be analyzed so quickly, users can easily cherry-pick positive results for publication, a practice known as p-hacking. “The flow of false discoveries is hugely greater,” says Matt Spick, a health-data scientist at the University of Surrey.

“My biggest concern,” Wang says, “is that doctors in 10 years’ time want to look into a particular concept and they go into the literature and everything is just associated with everything.”
 
Is this actually a new problem, or just a speed-up of old problems due to new technology? I expect there were plenty of papers published using methods designed to provide good-looking-but-misleading results, long before computers sere developed. Unapproved photos of celebrities have increased greatly too due to technology advances.

Hopefully other advances will help filtering out the bad studies.

... and new advances will help make more bad studies that try to bypass the filters. It's a never-ending battle.
 
But the combination of inexperienced users and TriNetX’s push-button analysis tools can lead to shoddy publications, which often do not correct for potential biases that can make treatments appear more effective than they are. And because the data can be analyzed so quickly, users can easily cherry-pick positive results for publication, a practice known as p-hacking. “The flow of false discoveries is hugely greater,” says Matt Spick, a health-data scientist at the University of Surrey.
So, same as before, but faster? The problem isn't speed, then, it's:
the resulting papers are a relatively easy way for medical students to boost their CVs before applying for residencies
It shouldn't be easy to do bad things. Bad things shouldn't be rewarded, whether they are done quickly or not. Bad things are an easy way to get ahead in this industry. This is a problem that has nothing to do with the tools themselves, and everything to do with the reward structure.
 
most TriNetX papers come from authors at U.S. medical schools, often with a physician-in-training as lead author. Medical schools use TriNetX as a research training ground, and the resulting papers are a relatively easy way for medical students to boost their CVs before applying for residencies. “There is no substitute for learning this process than by doing it,” says Lisa Howley of the Association of American Medical Colleges (AAMC).

The irony is that rather than teaching medical students how to do good research, the sort where there is a lot of thought about the question and the method, and collaboration with the people who will be affected by the research outcomes, this approach will be teaching them the exact opposite of what they should be learning.
 
Back
Top Bottom