2025: The 2019/24 Cochrane Larun review Exercise Therapy for CFS - including IAG, campaign, petition, comments and articles

Discussion in '2021 Cochrane Exercise Therapy Review' started by S4ME News, Dec 22, 2024.

  1. Trish

    Trish Moderator Staff Member

    Messages:
    58,823
    Location:
    UK
    It shouldn't take 3 years. They are mostly reviewing a single treatment, as far as I know. Compare that with the NICE evidence review that had to review evidence on all treatments and management for a condition and produce a guideline including taking feedback. I think that whole process only took about 3 years. Postgrad students do systematic reviews as a preliminary to research projects. They are not very complex.
     
    Kitty, MEMarge, tornandfrayed and 4 others like this.
  2. Trish

    Trish Moderator Staff Member

    Messages:
    58,823
    Location:
    UK
    Larun et al only included 8 trials, most very small. The whole review process is a major performance trying to squeeze some semblance of evidence of efficacy out of flawed trials.

    A quick read through the 8 trials would have told anyone unbiased and sensible that there was no evidence of clinically useful treatment in any of them. No need for complicated analyses, grading etc. It was barn door obvious that there was no objective or long term subjective advantage from GET.

    Cochrane have turned what should be basic common sense into a ridiculous circus that can't see the wood for the trees.
     
    Wyva, Kitty, obeat and 12 others like this.
  3. Utsikt

    Utsikt Senior Member (Voting Rights)

    Messages:
    2,313
    Location:
    Norway
    They self-reported an average of three years in early 2022. I don’t know what timeframe they measured over.
    It’s a farce.

    One thing I still don’t understand, is how the new review took so long time in the first place. The whole conflict fatigue argument seems to relate to relatively recent happenings. It would be very interesting to know the timeline.

    It also seems weird if any reviews of the previous review process, or any other happenings for that matter, were tied to the process of completing the new review. I could understand wanting to fix issues before doing it again, but what does that tell you about their confidence in their own processes?

    Even if you don’t consider the fact that they let vested interests taint their decision making, there’s no way for Cochrane to leave this with a favourable impression.
     
    Wyva, Kitty, MEMarge and 7 others like this.
  4. rvallee

    rvallee Senior Member (Voting Rights)

    Messages:
    14,520
    Location:
    Canada
    I think there was a much stronger quote from Tovey on this. S-W's mostly says the same thing but it wasn't as categorical.
     
    Ash, Kitty, MEMarge and 7 others like this.
  5. Robert 1973

    Robert 1973 Senior Member (Voting Rights)

    Messages:
    1,676
    Location:
    UK
    Perhaps something like:

    To ask the Secretary of State for Health and Social if he will review the government’s relationship with Cochrane through its departments and agencies following the charity’s decision to renege on its commitment to update its review of exercise therapy for chronic fatigue syndrome [1], given that: (a) at the time the review was published Cochrane was funded by the NIHR and it continues to receive funding through NICE; (b) Cochrane’s editor-in-chief acknowledged that the review was out of date and would ‘not resolve all the ongoing questions about this globally important health topic’ [2]; (c) the review directly contradicts the NICE Guideline for ME/CFS [3]; (d) over 15,000 individuals and 79 ME/CFS and Long Covid organisations have signed a petition calling for the review to be withdrawn [4,5]; (e) the decision to abandon the update has been criticised by the Independent Advisory Group for stakeholder engagement for the review [6]; (f) Cochrane also misled the public about the efficacy of masks in preventing the spread of Covid-19 [7,8]
    It's not perfect but it would at least be a request for action, as required by the WPQ rules above. If anyone has any suggestions, please let me know. Otherwise I will write to my MP over the weekend with my suggestions and see what she thinks.
     
    Ash, rvallee, Kitty and 11 others like this.
  6. Peter Trewhitt

    Peter Trewhitt Senior Member (Voting Rights)

    Messages:
    4,718
    Excellent, but would it be worth also pointing out that the Government also pays Cochrane to make the library available free of charge in this country, so in the case of the CFS Exercise review the government are paying for people to access something that argues for a treatment that NICE rejects as harmful for people with ME/CFS.
     
    Ash, Missense, rvallee and 6 others like this.
  7. Robert 1973

    Robert 1973 Senior Member (Voting Rights)

    Messages:
    1,676
    Location:
    UK
    According to Hilda NICE pays for it in England and the Health Departments pay for it in other parts of the UK (ie Wales, Scotland and NI):
    I’m concerned that the question may already be too long, so let me know if you can suggest wording which might improve it without making it longer.
     
    Last edited: Feb 20, 2025
    Ash, Kitty, MEMarge and 3 others like this.
  8. Hutan

    Hutan Moderator Staff Member

    Messages:
    32,046
    Location:
    Aotearoa New Zealand
    I think that's terrific @Robert 1973

    A few suggestions:


    I think the 'would not resolve all the ongoing questions' is the weaker part of the statement. A review might not resolve all the ongoing questions and yet be true and useful for clinical decision-making.

    Maybe, "Cochrane's Editor-in-Chief acknowledged in 2019 that the review used research questions and methods from 2002 and that a new approach was needed"?



    maybe "the decision to abandon the update has been criticised by the Independent Advisory Group for the review that Cochrane itself established "?
    I think it's worth noting that the IAG is not some random group but was created by Cochrane to advise it.



    Maybe "Cochrane appears to be having problems with quality control, notably regarding reviews regarding masks as part of PPI to prevent the transmission of Covid-19 and [the issue to do with cesarean births]."

    I think Cochrane might be able to argue that it didn't mislead but was misunderstood. Rubbish of course, but maybe it's more effective to suggest that there is a systemic problem. An MP might be more comfortable with that approach too.
     
    Ash, Kitty, Arvo and 7 others like this.
  9. Nightsong

    Nightsong Senior Member (Voting Rights)

    Messages:
    1,083
    Just a quick thought: there are some potentially useful quotes from HB's recent blogs that could be attributed to "a founder of Cochrane" that might be useful for this or other government/Parliamentary correspondence - e.g. in her Balancing Act blog she said that "[t]he way it has gone about this raises serious red flags about the organization’s current course" and that Cochrane has "veered away from its principles of openness, responsiveness to criticism, and accountability". There may be choicier quotes still (don't have the energy at the moment to read back through them all)
     
    Ash, Wyva, Kitty and 6 others like this.
  10. Hutan

    Hutan Moderator Staff Member

    Messages:
    32,046
    Location:
    Aotearoa New Zealand
    On the issue about a possible controversial review on steroid injections for cesarean births - that was mentioned in a German article linked and translated upthread. I haven't found much about the issue online. Obviously we'd need to be sure about it.
     
  11. Nightsong

    Nightsong Senior Member (Voting Rights)

    Messages:
    1,083
    I tried to find a source earlier on the steroids-in-caesarean-births claim. It seems there was a debate over the use of antenatal corticosteroids, particularly the applicability of the research to low-resource / developing countries. There are a number of papers discussing this; I haven't got the energy to go through them all, but some quotes from one, "Antenatal corticosteroids for women at risk of imminent preterm birth in low-resource countries: the case for equipoise and the need for efficacy trials". (Not entirely sure that this is what is being referred to in the German article, but seems like a good candidate.)
     
    Ash, Kitty, Arvo and 2 others like this.
  12. Sean

    Sean Moderator Staff Member

    Messages:
    8,828
    Location:
    Australia
    And all too often don't want to.
     
    Kitty, MEMarge and Peter Trewhitt like this.
  13. Hutan

    Hutan Moderator Staff Member

    Messages:
    32,046
    Location:
    Aotearoa New Zealand
    That's an interesting read @Nightsong.

    The Cochrane review was published in March 2017 and this rebuttal of it was received in May 2017 and published in June 2017. I haven't finished reading it, but it seems as though the Cochrane review was poorly done. I'm surprised that the rebuttal didn't seem to produce much media coverage. The review may well have produced a range of negative outcomes.

    I don't think there is a paper that is specifically a rebuttal of the Larun et al review yet? It's certainly something that we could do. It might get some attention in places where we aren't making much headway.
     
    SNT Gatchaman, Wyva, Kitty and 5 others like this.
  14. Jonathan Edwards

    Jonathan Edwards Senior Member (Voting Rights)

    Messages:
    16,900
    Location:
    London, UK
    Yes,my memory is that Tovey was much more straightforward. I still think @dave30th might have something on this. He talked to Tovey.
     
    Ash, Kitty, Robert 1973 and 3 others like this.
  15. tornandfrayed

    tornandfrayed Senior Member (Voting Rights)

    Messages:
    167
    Location:
    Scotland
    Really good, @Robert 1973 and Hutan's suggestions.

    Is it worth mentioning the international reach of the petition?
     
    Ash, SNT Gatchaman, Hutan and 5 others like this.
  16. Caroline Struthers

    Caroline Struthers Senior Member (Voting Rights)

    Messages:
    1,032
    Location:
    Oxford UK
    I don't know if you can quote correspondence obtained via FOI, but there are lots of quotes from Tovey, including...

    "I am afraid that I am not able to publish this version...either one should downgrade the certainty of evidence further, or it should be acknowledged that the magnitude of the effect is likely small" 27 May 2019
    [my bold. in the end, they did neither of those things and the review still says there is moderate certainty evidence of a positive effect]

    "I believe that we have reached the end of the road. I do not anticipate that you are willing to go further than you have now, and it is my judgement that my successors are unlikely to be willing to
    publish a future version of this review" 24 May 2019

    "Cochrane and the review author team have been unable to agree on revisions to the review, and therefore, with regret, it will now be withdrawn from the Cochrane Database of Systematic Reviews.
    The Cochrane authors are not in agreement with this decision" Suggested press announcement, 27 May 2019

    "the conclusion that this is moderate certainty evidence seems indefensible to me, and as we know, I am not alone in this" 27 May 2019

    https://acrobat.adobe.com/id/urn:aaid:sc:EU:d4b5c8dd-59e8-4f51-8cfd-998fbb3a275e
     
    Joh, Ash, dave30th and 11 others like this.
  17. Utsikt

    Utsikt Senior Member (Voting Rights)

    Messages:
    2,313
    Location:
    Norway
    This is not on topic for the question, and it might be used as an opportunity to derail the response.
    I’m not certain it’s an issue of quality control per se. Based on the quotes by @Caroline Struthers , it seems like an issue of governance, integrity and conflict shyness.

    I don’t understand why this would even be relevant to mention publically. The opinions of the authors should be completely irrelevant to any decision regarding the publication or withdrawal of the reviews. The only reason would be to publically distance themselves from the authors, but then again, it was Cochrane that published the review in the first place. I’m confused..

    Why not? The fact that the correspondence was covered by FOI means that it always has been public information even before the FOI request. It just wasn’t broadcasted.

    You can’t have any expectation of privacy if you communicate with someone that’s covered by FOI laws, and the same goes if you’re covered yourself due to your position. Everything said is instantly considered public.
     
    Sean, Hutan, rvallee and 3 others like this.
  18. Nightsong

    Nightsong Senior Member (Voting Rights)

    Messages:
    1,083
    There was the Vink reanalysis paper:

    "Graded exercise therapy for myalgic encephalomyelitis/chronic fatigue syndrome is not effective and unsafe. Re-analysis of a Cochrane review" (2018)

    and an evaluation of the 2019 update to Larun:


    "Graded exercise therapy does not restore the ability to work in ME/CFS – Rethinking of a Cochrane review" (2020)
     
    Ash, Deanne NZ, SNT Gatchaman and 7 others like this.
  19. Caroline Struthers

    Caroline Struthers Senior Member (Voting Rights)

    Messages:
    1,032
    Location:
    Oxford UK
    I think Cochrane, under Tovey, and then even more so under Soares-Weiser, is a review author (emotional/career/marketing) support service. They seem to be mostly concerned with looking after their authors and making sure they're happy, have a great experience etc because they operate a volunteer model and they want authors to do as much as possible for free, and then charge the world for their work. I think attention to detail in picking up when authors have something to sell (even if it's not a drug) and want to produce a review to sell that thing is not high on Cochrane's agenda

    Her vision “to improve health care decision making by consistently publishing timely, high priority, high-quality reviews responding to the needs of our end-users. I am committed to working with the Cochrane community to achieve this vision, strengthening diversity, and striving for an excellent author experience.” https://www.cochrane.org/news/introducing-karla-soares-weiser-editor-chief-cochrane-library
     
    Sean, Deanne NZ, Hutan and 6 others like this.
  20. Utsikt

    Utsikt Senior Member (Voting Rights)

    Messages:
    2,313
    Location:
    Norway
    That’s very far from how they describe themselves!

    Has the public caught on to this yet?
     
    bobbler, rvallee, Kitty and 2 others like this.

Share This Page