Cochrane under pressure: Decision to revise ME/CFS study causes outrage
The scientific integrity of the Cochrane Collaboration has come under criticism after the organization abruptly stopped its planned independent revision of a controversial review on exercise therapy for myalgic encephalomyelitis/chronic fatigue syndrome (ME/CFS). In addition, the review, originally published in 2019, has now been re-dated to 2024, although the content has remained unchanged and is based on outdated studies.
Scientific independence in danger?
Cochrane is internationally recognized for its evidence-based reviews of medical interventions. Due to ongoing criticism of the methodology of the study published in 2019, Cochrane commissioned an independent group of authors and an independent advisory group (IAG) to re-analyze the study. The IAG consisted of representatives of ME/CFS patient organizations, medical specialists and experts in systematic reviews.
However, after almost five years of intensive work, countless meetings and the review of thousands of pages of scientific literature, the project was suddenly stopped in December 2024. Cochrane justified this by saying that there was no new relevant evidence that would justify a revision.
Outdated studies as current evidence?
The decision to update the review simply by adding a new publication reference without revising the content is particularly controversial. This could give the impression that a new scientific review has taken place and that the statements made therein are still valid. In fact, however, the analysis is based on studies that are at least ten years old and are no longer considered sufficient according to today's scientific standards.
A key point of criticism is that the original study did not differentiate between patients with and without post-exertional malaise (PEM). PEM is considered a leading symptom of ME/CFS and is also widespread in long-COVID patients. Numerous sufferers report a deterioration in their health after exercise therapy, an observation that is supported by current scientific research.
Protest from science and patients
The IAG has expressed its concern about the sudden turnaround in an open letter to the Cochrane committee. The experts are particularly critical of the lack of transparency in the decision and the refusal to publish an editorial note pointing out the outdated data.
"As an organization that claims to provide trustworthy evidence, Cochrane has an obligation to deal responsibly with outdated reviews," the letter states. A response from Cochrane is still pending.
Loss of trust in Cochrane
The controversy surrounding the ME/CFS review is not the first time that Cochrane has come under fire for poor scientific work. An earlier review on the effectiveness of masks against COVID-19 was sharply criticized in professional circles, as was an analysis of steroid injections during cesarean births that was based on flawed studies.
"At a time when we depend on reliable scientific institutions, it is frightening that we can no longer rely on Cochrane - neither on issues of ME/CFS treatment nor in other essential areas of public health," commented Jaime Seltzer, scientific director of #MEAction, an organization for ME/CFS sufferers.
The current debate raises fundamental questions about scientific integrity and the responsibility of institutions such as Cochrane. It remains to be seen whether and how the organization will respond to the growing pressure.