2025: The 2019/24 Cochrane Larun review Exercise Therapy for CFS - including IAG, campaign, petition, comments and articles

Discussion in '2021 Cochrane Exercise Therapy Review' started by S4ME News, Dec 22, 2024.

  1. Utsikt

    Utsikt Senior Member (Voting Rights)

    Messages:
    288
    Location:
    Norway
    It’s like how lawyers or auditors oversee eachother.
     
  2. Sasha

    Sasha Senior Member (Voting Rights)

    Messages:
    4,602
    Location:
    UK
    Surely the editors of every major journal can't be in on the conspiracy of silence.
     
    Sean, alktipping, Kitty and 1 other person like this.
  3. Utsikt

    Utsikt Senior Member (Voting Rights)

    Messages:
    288
    Location:
    Norway
    I doesn’t surprise me.
     
    Kitty and Peter Trewhitt like this.
  4. Utsikt

    Utsikt Senior Member (Voting Rights)

    Messages:
    288
    Location:
    Norway
    Why not? Power and money are potent motivators.
     
    Sean, alktipping, Kitty and 3 others like this.
  5. Trish

    Trish Moderator Staff Member

    Messages:
    57,087
    Location:
    UK
    I agree. I was talking about least worst options not ideal options.

    The ideal, as far as I'm concerned, would have been to do a proper update with correct methodology which would have found exercise useless and potentially harmful for anyone with chronic fatigue, including ME/CFS.

    And Cochrane recognising the stuff about unblinded trials and subective outcomes publicly and withdrawing a whole swathe of other reviews.
     
    janice, alktipping, rvallee and 8 others like this.
  6. SNT Gatchaman

    SNT Gatchaman Senior Member (Voting Rights)

    Messages:
    6,203
    Location:
    Aotearoa New Zealand
    Sean, Amw66, bobbler and 8 others like this.
  7. Midnattsol

    Midnattsol Moderator Staff Member

    Messages:
    3,853
    While we are taught about double blind, the cop-out when not being able to blind the participant is the same as the BPS are using: "It's difficult" and left at that. Nothing about how using objective outcomes could reduce the issue, or that subjective outcomes would be an additional issue. And since everyone is doing it then it must be fine.
     
  8. Peter Trewhitt

    Peter Trewhitt Senior Member (Voting Rights)

    Messages:
    4,468
    I was taught as a psychology undergraduate forty five years ago that unblinded trials with subjective measures were inherently unreliable. Our lecturers did not go as far as to say this design should never be used, but that you could not rely on evidence from such trials alone.

    In some clinical situations it may be very difficult to achieve the ideal design but then you need to seek convergent evidence from studies using different methodologies, in the hope you can counter balance the unavoidable bias in your initial study.

    However, the ME/CFS exercise studies don’t all lack objective evidence. Many including PACE did include objective outcomes. However these studies either abandoned or sought to obscure these objective outcomes. The original protocol for Larun et al deliberately excluded consideration of the objective outcomes. Is it because as some researchers have tried to argue that ME/CFS is an inherently subjective experience so it can only be measured by patient self report or that the objective outcomes fail to provide the desired result. Also strangely the researchers are reluctant to even acknowledge the existence of patient reported harms.

    [edited to add final paragraph]
     
    Last edited: Jan 29, 2025 at 9:31 AM
    janice, EndME, Sean and 13 others like this.
  9. Midnattsol

    Midnattsol Moderator Staff Member

    Messages:
    3,853
    When collecting diet intake data in large studies, we are supposed to validate using a method with different bias. In practice food frequency intake questionnaires are used and then "validated" by performing a diet intake interview with a selection of the participants (both have similar biases like recall and reporting bias). If they are validated at all. A few use double-labelled water and that can validate energy intake but it's difficult to do at scale.

    I seem to recall a table with "rules" in Norwegian, but I can't find it again but as I recall it was like this for when something is seen as reliable:
    Two large cohort studies that point in the same direction
    One cohort study can be exchanged by five case-control studies

    These studies can have the same biases so the rules don't work, but here we are.
     
    Sean, alktipping, Deanne NZ and 5 others like this.
  10. Caroline Struthers

    Caroline Struthers Senior Member (Voting Rights)

    Messages:
    1,019
    Location:
    Oxford UK
    I said this over and over to Hilda and she was determined it would go ahead. I paraphrase, but her response to me was "we're doing it whether you like it or not, and that's that"
     
    janice, EndME, Amw66 and 11 others like this.
  11. Utsikt

    Utsikt Senior Member (Voting Rights)

    Messages:
    288
    Location:
    Norway
    Hutan, Ash and Peter Trewhitt like this.
  12. Caroline Struthers

    Caroline Struthers Senior Member (Voting Rights)

    Messages:
    1,019
    Location:
    Oxford UK
    They're blowing on it for a bit ;-)
     
    Sean, Amw66, Kitty and 4 others like this.
  13. Caroline Struthers

    Caroline Struthers Senior Member (Voting Rights)

    Messages:
    1,019
    Location:
    Oxford UK
    I think they are
     
    Sean, alktipping, bobbler and 8 others like this.
  14. Peter Trewhitt

    Peter Trewhitt Senior Member (Voting Rights)

    Messages:
    4,468
    MEAction are continue to address the Cochrane exercise review debacle, they sent this email to their supporters list today:

     
    Sean, Amw66, alktipping and 6 others like this.
  15. Kitty

    Kitty Senior Member (Voting Rights)

    Messages:
    7,391
    Location:
    UK
    I wonder how much if this is coming from government.

    A lot of financial, political and ideological capital has been invested in the exercise-is-medicine and CBT-cures-everything approach.

    With millions affected by chronic ill health and the possibility that social factors are responsible for nearly as much of it as disease, they haven't got much else to offer.
     
    JellyBabyKid, janice, Sean and 9 others like this.
  16. Peter Trewhitt

    Peter Trewhitt Senior Member (Voting Rights)

    Messages:
    4,468
    Interesting that MEAction are focusing solely on the editorial note rather than withdrawal, stressing their link to the IAG and avoiding any mention of our ‘withdraw of Larun et al’ campaign.

    It maybe that they regard the editorial note as the most realistic goal, though it seems to me something of a cop out, in it gives Cochrane a way of putting the issue to bed if the outcry gets too embarrassing, without addressing the central problem of the inherent bias in the use of subjective outcomes in unblinded trials. Both @Hutan and I reference these wider issues in our comments on the MEAction blog. I wonder, given our comments are still lurking in moderation (echoes of Hilda’s moderating strategy), if our demand for withdrawal of the old review is a hot potatoe for them too.
     
    Sean, Missense, alktipping and 7 others like this.
  17. Hutan

    Hutan Moderator Staff Member

    Messages:
    30,777
    Location:
    Aotearoa New Zealand
    I don't want you thinking we are dismissing this risk. It is a true risk. It is possible that a Fukuda cohort has no people with PEM in it. But, look at the Fukuda criteria. You aren't just picking up people with chronic tiredness, they have to have other things going on too, and they may have PEM lasting 24 hours as one of the required four extra symptoms. I think the risk of a Fukuda cohort not having people with PEM in it is quite low; requiring results to be replicated from multiple studies can help to cover that risk.

    Yes, making a selection criteria for a trial as precise as possible is important. I don't think anyone here is saying that using the Fukuda criteria is a good thing, and the problems get even worse when researchers use less restrictive versions of Fukuda. We do want to see studies trying to ensure that people labelled as having ME/CFS all do report PEM.

    But. As Jonathan said, the BPS studies on GET, even using the Fukuda criteria, even with their subjective outcomes and lack of blinding, even with all the other various flaws, have pretty much failed to find any clinically relevant benefit. For anyone. Reported benefits slosh around in the range that is entirely compatible with a placebo treatment.

    Focusing on the issue of the diagnostic criteria distracts from this main message of studies with a very high risk of bias and small to very small reported benefits that cannot be differentiated from placebo responses.
     
    EndME, Sean, alktipping and 4 others like this.
  18. Utsikt

    Utsikt Senior Member (Voting Rights)

    Messages:
    288
    Location:
    Norway
    @Hutan I agree that methodology is the core issues.

    But it should also be noted that when you don’t differentiate based on PEM, all of the responders could have been the non-PEM patients.

    In itself, that makes the studies non-generalizable to ME/CFS with PEM.

    If they fix their methodology, but don’t fix the inclusion criteria, we might end up with robust studies that are still wrong. They need to require both to include a study in the review.

    Which unfortunately means that most of the current research is useless due to older criteria being used.
     
    Sean, alktipping, bobbler and 3 others like this.
  19. Hutan

    Hutan Moderator Staff Member

    Messages:
    30,777
    Location:
    Aotearoa New Zealand
    I so do not understand where Trisha Greenhalgh is on this. I haven't been following closely but she seemed to be prejudiced against people with ME/CFS, blocking reasonable people on Twitter. But argues against people with Long Covid being subject to BPS ideas? And now she is retweeting Jacqui Wise's good article in the BMJ that is supportive of people with ME/CFS?

    Perhaps it doesn't really matter what she thinks, although she seems to pop up in various influential places. But, does anyone understand what is going on there?
     
    Last edited: Jan 29, 2025 at 1:06 PM
    Sean, Missense, alktipping and 7 others like this.
  20. Hutan

    Hutan Moderator Staff Member

    Messages:
    30,777
    Location:
    Aotearoa New Zealand
    I think those horribly flawed studies can still tell us something though. If you can bias your study so badly in favour of finding a positive result, and, at the end of it you still can't show that exercise therapy provides a benefit for people with chronic fatigue above a level easily achieved with a placebo, that is useful information.
     
    Sean, alktipping, Ash and 5 others like this.

Share This Page