2025: The 2019/24 Cochrane Larun review Exercise Therapy for CFS - including IAG, campaign, petition, comments and articles

Discussion in '2021 Cochrane Exercise Therapy Review' started by S4ME News, Dec 22, 2024.

  1. rvallee

    rvallee Senior Member (Voting Rights)

    Messages:
    14,079
    Location:
    Canada
    Definitely, but it does speak to a broader, common, pattern of behavior, one that seems to be considered acceptable in a very limited context. That more than one group are behaving the same actually makes it a lot worse, in my opinion. But that may take too many words to spell out here.
     
    Kitty, Amw66, Deanne NZ and 4 others like this.
  2. Jonathan Edwards

    Jonathan Edwards Senior Member (Voting Rights)

    Messages:
    15,976
    Location:
    London, UK
    I don't know but I suspect not. Presumably the trial authors said that Cochrane could only have their raw data if they could be authors. Not sure what sort of theatre but maybe No?
     
    Kitty, Ash, Deanne NZ and 6 others like this.
  3. Hutan

    Hutan Moderator Staff Member

    Messages:
    30,777
    Location:
    Aotearoa New Zealand
    Still no comments showing on the MEAction blog
     
    Kitty, Ash, alktipping and 6 others like this.
  4. Hutan

    Hutan Moderator Staff Member

    Messages:
    30,777
    Location:
    Aotearoa New Zealand
    I'm wondering, what do people think about the new review being abandoned? I mean, apart from it being a sign of a massive amount of disrespect towards people with ME/CFS from Cochrane, and making the five years of effort from Hilda, the writing group and the IAG a colossal waste of time, are we upset that the new Cochrane review isn't proceeding?

    I'm feeling quite ambivalent. No, I think it might even be a good thing. Nothing I'm seeing from anyone suggests to me that Cochrane or the people involved in the new review process, taken as a collective, are willing to identify the fundamental problem with the CFS exercise therapy studies. I have serious doubts that the review, even without active Cochrane interference, would have been what we think it should be.

    And of course, given it would have been a Cochrane product, the editors and whatever forces that seem to govern their actions would have still had control. Things might have still fallen apart, just another year down the track, with the time and energy of people with ME/CFS having continued to be sucked into the black hole of Cochrane.

    It seems to me that Cochrane has acted so egregiously badly, the warnings we gave Hilda when she was engaging on the forum have been proven to be well-founded, the relabelling of the 2019 review as 2024 is so preposterous, that perhaps their actions have actually helped us shine a light on the problems?

    So, perhaps we don't want to beg Cochrane to restart the process? Perhaps we should sigh with relief that that episode is over and we can get on with getting rid of the Larun et al review without the distraction of a new review process? Perhaps it would be best if a good independent team of people wrote a review of exercise therapy for ME/CFS? Or perhaps a new review isn't needed at all.

    I don't know. What are you thinking? What are the members of the IAG and writing group thinking?
     
    Robert 1973, EndME, Michelle and 16 others like this.
  5. Jonathan Edwards

    Jonathan Edwards Senior Member (Voting Rights)

    Messages:
    15,976
    Location:
    London, UK
    No, it should never have been proposed. We know all we need to know from the NICE analysis. It was only ever playing Cochrane's own brand of football where if they are losing they are allowed a free kick with the goalie blindfolded.

    If the old review was bad enough to justify a rewrite it should have been pulled and that would have been fine. The whole exercise was barmy.
     
    EndME, Kitty, Ash and 18 others like this.
  6. Yann04

    Yann04 Senior Member (Voting Rights)

    Messages:
    1,380
    Location:
    Romandie (Switzerland)
    Personally I agreed with messages a couple weeks ago here saying things along the lines of “this means the 2019 review will slowly become irrelevant” and therefore it probably isn’t that bad because once in a couple years the review is a decade old it won’t look trustworthy in citations anymore and that will be the end of it.

    But now I’m very concerned by the trick they used to update the date without the content, makes me more ambivalent. Although I agree with Hutan that the IAG wouldn’t have been perfect, it did contain lots of advocates who I think would have insured it did a much better job than Larun.
    And them having a 2024 citation means they can dishonestly extend the influence of flawed studies from the 90s and 2000s for a long while to come…
     
    Sly Saint, Kitty, Skycloud and 9 others like this.
  7. Sasha

    Sasha Senior Member (Voting Rights)

    Messages:
    4,602
    Location:
    UK
    I couldn't care less. The 2019 Larun review should never have been published, and once it was, and criticism make it clear how bad it was, it should have been immediately taken down. The new review has just distracted attention from this stinking review being left in place, with all its potential harm to patients.
     
    Kitty, Ash, Skycloud and 7 others like this.
  8. Trish

    Trish Moderator Staff Member

    Messages:
    57,087
    Location:
    UK
    I'm coming round to that view too. Though at the time it was set up in October 2019, we were a year away from even seeing the NICE draft review, and two years from its publication in October 2021. If Cochrane had stuck to their 2 year timetable, their new review would have come out shortly after the NICE review, and could even have been influenced by it.
    Now 3 years further down the track, it's far better if Cochrane withdraw the Larun review and refer people to NICE.
     
    Michelle, Kitty, Skycloud and 12 others like this.
  9. Peter Trewhitt

    Peter Trewhitt Senior Member (Voting Rights)

    Messages:
    4,468
    I agree any new exercise review is totally redundant given the NICE evidence review, the only potential advantage might be that a stand alone journal article might make the inappropriateness of exercise based interventions for ME more accessible to the medical community, however it would add no new information to the topic. Further the worry of a new review overseen by Cochrane is that they can no longer be relied on as objective arbiters (assuming they ever could be).

    However what is worrying is Cochrane’s exertions to give spurious credibility to the flawed Larun et review. Here is where we must fight, only using their abandonment of any new review process to undermine their credibility and the credibility of Larun et al (2019 mislabelled as 2024).

    So far all Cochrane have achieved is to give us ammunition against the current flawed review, as long as all the current publicity can be used to draw wider attention.

    [edited to clarify wording]
     
    Last edited: Jan 28, 2025 at 8:20 PM
    Kitty, Ash, Skycloud and 7 others like this.
  10. Hutan

    Hutan Moderator Staff Member

    Messages:
    30,777
    Location:
    Aotearoa New Zealand
    Yes, that's what I'm thinking too. The 2024 label together with the editorial note asserting that there is no new evidence is the problem that we should concentrate our efforts on. It's as if Cochrane are saying 'Magenta? Never heard of it'.

    Along with progressing the complaint that Cochrane has no working quality control/complaints process.
     
    Kitty, Ash, Skycloud and 9 others like this.
  11. Trish

    Trish Moderator Staff Member

    Messages:
    57,087
    Location:
    UK
    Magenta was on children. The Larun review explicitly says it's only about adults. Even so, I think Magenta is a valuable contribution on harms as well as ineffectiveness, and should be included.
     
  12. Nightsong

    Nightsong Senior Member (Voting Rights)

    Messages:
    863
  13. bobbler

    bobbler Senior Member (Voting Rights)

    Messages:
    4,250
    you are opening a can of worms with that question to me - many thoughts (including that it doesn’t mean they won’t just reconvene another one getting rid of any pesky method or honourable persons being involved ‘fir balance’ etc)
     
    Kitty, Hutan and Peter Trewhitt like this.
  14. Utsikt

    Utsikt Senior Member (Voting Rights)

    Messages:
    288
    Location:
    Norway
    I can’t help but think that these questions should have been handled by the various associations a long time ago.

    I’m baffled by how uncoordinated and ineffective they appear to be, from the vantage point of a passive bystander.

    It seems like they are mostly reactive instead of proactive.

    As an example - why was the initial review left to the BPS lobby in the first place? Surely the PACE trial displayed a need to control the narrative around how data is being interprerated? We’ve known that the GET research is terrible for ages - why not formalize it?

    Are there «political» reasons for why they couldn’t contribute to a Cochrane review?
     
    Kitty, alktipping, bobbler and 3 others like this.
  15. rvallee

    rvallee Senior Member (Voting Rights)

    Messages:
    14,079
    Location:
    Canada
    I really don't think we can make much of a difference as long as garbage quality studies are considered good evidence. Even in the best case scenario where everything about this review would have worked out, so what? It's not as if anyone has any obligation to accept facts. NICE is more authoritative for the UK and even that made no difference, they just ignore it.

    Meanwhile most studies are still garbage and basically copy-paste of the same old. And all the evidence accumulated so far out of Long Covid research still makes no difference because there's always garbage quality pseudoscience that can be pointed at to continue not to bother.

    The people behind this keep proving themselves to be awful and unprofessional, and it also makes no difference. It's all politics and we have no representation in that system, and we are hated that much.

    No idea what this means about what next steps we can take about an issue where being right makes no difference and doing massive harm is perceived as good.

    I still think that going against the garbage standards in evidence-based medicine is about the only thing worth our efforts. But it would likely have little impact because everything hinges on a similar event as with peptic ulcers, where the whole thing is explained and the pseudoscience is simply made obsolete.

    There is definitely some merit to completing this review, given all the work that's been done. But it would be less influential and given what Cochrane has done so far, I kind of expect that they'd simply make another fake update to push back the date, make it more current, so that it would still be the latest.

    It's a seriously rotten situation. So much that it's impossible to fix it because almost no one believes medicine can be this broken. So it gets even more broken with time, which makes it even less believable.
     
  16. Hutan

    Hutan Moderator Staff Member

    Messages:
    30,777
    Location:
    Aotearoa New Zealand
    That's wonderful. It's a short straightforward article quoting the BMJ article by Jacqui Wise, with some clear comments from Charles Shepherd.
    Thanks very much to the UK MEA.
     
    Robert 1973, Missense, Maat and 8 others like this.
  17. Trish

    Trish Moderator Staff Member

    Messages:
    57,087
    Location:
    UK
    It goes back much further than PACE. BPS supporters have been in key positions at Cochrane from the start, as I understand it. And they determined who got to write reviews, which ones they accepted and how studies are analysed. For example, none of them seem to understand that subjective outcomes in unblinded trials are unreliable and should not be used as the primary outcome measure. That should have made the 2002 protocol unacceptable along with all the versions of the review based on it.
     
    EndME, Maat, Kitty and 9 others like this.
  18. Hutan

    Hutan Moderator Staff Member

    Messages:
    30,777
    Location:
    Aotearoa New Zealand
    Over 14,700 signatures on the petition.
     
    Kitty, Ash, Skycloud and 6 others like this.
  19. Medfeb

    Medfeb Senior Member (Voting Rights)

    Messages:
    607
    Playing devils advocate here - Would it be acceptable for a study of an asthma intervention to use any old criteria, including those that specifically do not require people to actually have asthma? Especially if that intervention to be tested was known to exacerbate the core symptom of asthma?

    IMO, this is a key methodological issue right up there with subjective findings in unblinded trials, outcome switching, etc.
     
    Missense, Kitty, Skycloud and 9 others like this.
  20. Hutan

    Hutan Moderator Staff Member

    Messages:
    30,777
    Location:
    Aotearoa New Zealand
    There are different sorts of asthma that you ideally might want to stratify out and treat differently, although they have often been lumped together in one study e.g. asthma caused by an allergy, asthma caused by exercise, and, for all I know, it may be hard to differentiate these, maybe they overlap, maybe we now know other sorts of asthma, maybe we will discover that there other sorts of asthma that we don't know now. Even with exercise-induced asthma, it could be a reasonable study question to ask - does careful exposure to exercise help?

    So, it could be reasonable to do a study combining different sorts of asthmatics and see if exercise helps. Maybe it helps nobody, and then you know something. Maybe it only helps some, and so you have questions for another study. The biggest problem is if you use the faulty study design that gives you a positive result, regardless of treatment.

    Your choice of the asthma example is interesting because there is that fantastic study where they told people that they were being given an effective asthma treatment and gave some people a placebo. The people with the treatment and the placebo both reported that their asthma was considerably better. But only the people with the treatment had improved respiratory function. That is the demonstration of the problem we are concerned about. I'll see if I can find a link.

    If you do a mixed asthma study (allergic asthma, exercise-induced asthma, maybe some people have both) with only subjective outcomes and no placebo, everyone might seem better. Was it because they hoped they were better, or were they really better? You don't know. You have not learned anything.

    *****
    Honestly, how good are the ME/CFS diagnoses? Even experienced clinicians are struggling. We've seen that in the rate of misdiagnoses identified. Even if you think you have a "pure" ME/CFS cohort it will be mixed.

    Take a group of people diagnosed under the Fukuda criteria, use a good objective outcome such as tracking their activity levels over 6 months, have two treatments that the participants think are equally likely to work, and you might be able to say that the treatment truly helped some people. Or it didn't. You have learned something. Until we have a biomarker, if you truly find exercise does help some people with chronic fatigue, it could be a reasonable thing to say 'look, we know that exercise truly does help some people with chronic fatigue, but our data also shows that it truly can set some people back'. So, we need to investigate the people who improved versus the ones who didn't because we aren't very good at knowing in advance. And, we need to be very alert to whether you might have PEM if you do decide to exercise.

    Alternatively, if you find that exercise truly helps no one with Fukuda chronic fatigue, things are simple, don't recommend it to anyone.

    Or, take a group of people carefully diagnosed under CCC or IOM. Give them a programme of a treatment you say is great, even exercise, then ask them how they feel. Some will drop out, but you don't count them. The ones who make it to the end of the six weekly sessions and the celebratory cake will report on your subjective survey, 'I feel better'. And that goes into a review with other similar studies, and there you have it, scientifically proven!, Cochrane gold-standard endorsed! Impossible to question. Exercise helps people with CCC criteria ME/CFS.
     
    Last edited: Jan 29, 2025 at 12:58 AM

Share This Page