Independent advisory group for the full update of the Cochrane review on exercise therapy and ME/CFS (2020), led by Hilda Bastian

Discussion in '2021 Cochrane Exercise Therapy Review' started by Lucibee, Feb 13, 2020.

  1. Robert 1973

    Robert 1973 Senior Member (Voting Rights)

    Messages:
    1,353
    Location:
    UK
    You referred to the “demonization of an entire community because of the behavior of a few” and “the stigma that flows from all being judged by the behavior of a minority”. I think it is reasonable to infer from those comments that you were implying that some people have behaved inappropriately and/or unethically. If you don’t want to say what behaviours you are referring to, please could you stop referring to them? I think it is clear that many of us find these unspecified references unhelpful at best.

    It might also be helpful if you could explain why you are unwilling to give any details of any of the behaviours you have referenced.

    As others have pointed out above, the history is important here. As you highlighted in one of your blogs (for which I was grateful), people with ME have been the victims of “unconscionable” orchestrated “collective ad hominem attacks” from some researchers, in which legitimate and necessary activities, including valid scientific criticism, has been deliberately conflated with harassment and worse. It is also important to remember that many of the targets of these smear campaigns have been members of this forum. Given this context, I think it is particularly important not to suggest or imply that any ME groups or “activists” are behaving in a way that is counterproductive without being specific about what those behaviours are.

    A danger with internet discussions can be that people’s positions become more entrenched as disagreements escalate. I hope that will not be the case here. I have often had my opinions on subjects changed by the information and opinions that have read on this forum and I hope you may be similarly receptive. Thanks for reading and engaging with this thread.
     
    Sarah94, EzzieD, ukxmrv and 24 others like this.
  2. Hilda Bastian

    Hilda Bastian Guest Guest

    Messages:
    181
    Location:
    Australia
    I undertook to consult and consider alternative language to activist: I've done that, as well as some hunting around about the language people and groups use to describe themselves. Lots of activist/action and advocacy language. I've changed the language in the report to advocacy. Thank you!
     
    Simone, Inara, EzzieD and 24 others like this.
  3. cassava7

    cassava7 Senior Member (Voting Rights)

    Messages:
    1,008
    I'm afraid this only worsens the issue of her biases towards physical activity/exercise being reflected in the updated review.

    I understand better why her advisory roles in AfME and MERUK may have picked her given her advisory roles in AfME and MERUK. Unfortunately, there is a long history of issues with medical advisors to ME associations. For example, AfME had BPS proponents as advisors for many years, and they helped recruit participants for the PACE trial. However, I fully appreciate that you are not expected at all to know the long and arduous history of ME research and associations. As @Hutan offered, please do not hesitate to ask if you need more background on these issues.

    Edited to add: some MD-researchers outside the UK and US who have recently published on muscular or physiological aspects of ME/CFS, who MOSS could consider: Dr Carmen Scheibenbogen, Prof Yves Jammes / Dr Frédérique Retornaz, Dr Katarina Lien.
     
    Last edited: Jun 4, 2021
    EzzieD, alktipping, Michelle and 6 others like this.
  4. Sid

    Sid Senior Member (Voting Rights)

    Messages:
    1,066
    That one got lost in QMUL databases and conveniently cannot be retrieved. :rolleyes:
     
    EzzieD, alktipping, Michelle and 9 others like this.
  5. Robert 1973

    Robert 1973 Senior Member (Voting Rights)

    Messages:
    1,353
    Location:
    UK
    Yes, and wasn’t one of the reason’s given for why it couldn’t be retrieved because Peter White (who is currently publishing papers on CFS) had retired?
     
    Kirsten, EzzieD, alktipping and 14 others like this.
  6. Sly Saint

    Sly Saint Senior Member (Voting Rights)

    Messages:
    9,626
    Location:
    UK
  7. Mithriel

    Mithriel Senior Member (Voting Rights)

    Messages:
    2,816
    One of the things we have had problems with is that the oversight bodies for research all seem to have very narrow remits. I am too ill to go into details, this is just the overall outcomes but they have all been used by the BPS to claim that their research is valid and criticisms baseless. (An aside, but it can take someone with ME hours to write a post. Forums are not just places where people get together to reinforce their prejudices, here we are literally giving voice to the voiceless, often at great personal cost.)

    Despite the fact Cochrane agreed all criticisms of a review were valid it could not be changed because the authors refused and there was no mechanism to deal with that. An ethics review basically stated that all documents had been filled in at the right time but again this was used against us.

    I keeps happening; we get within spitting distance of officialdom but our problems with the research are so blatant that no one has considered it could possibly happen so there is no mechanism for redress.
     
    EzzieD, alktipping, Michelle and 15 others like this.
  8. Mithriel

    Mithriel Senior Member (Voting Rights)

    Messages:
    2,816
    ME papers are unlike others. The "research" that shows how good GET is needs very careful examination for things that are not usually encountered in a peer reviewed paper. The references do not always match the assertions in the paper. I stopped checking but now assume they are all dodgy if not to one of their friends.

    One paper from a few years back said that all people with chronic fatigue and ME are much the same with a reference to a paper that said that it was vital that people with ME were subtyped.

    Another said ME was not neurological as there were no problems shown in part of the brain which had been checked by MRI. This was true except the paper had found problems inn other areas that has been examined at the same time.

    Then the main problem with the PACE trial, that you could be sick enough to enter the trial with a score of 65 (where 100 is good health) at the beginning of the trial but at the end of the trial they changed recovery to 60, was hidden in the error range.

    A recent paper said in the abstract that 90% of patients were satisfied with the treatment and it was only scrutiny of the paper by forum members that made it clear that this 90% were people who had filled inn the questionnaire at the end of the course and did not include the large numbers who had dropped out.

    These are not easy things to pick out and anyone checking the papers must do so with a sceptical eye. They are carefully written to sound plausible and give the impression that treatments are a success.

    I was going to carry on but it is just more and more of the same.

    Peer reviewers seem unable to find the flaws in the methodology of BPS trials and editors of journals unable to see how logic fails in them and how often they break the code of conduct the journals claim to follow.

    We have good reason to want a robust proper review and to be sceptical that is what is going to happen. All too often there are rules but they can be broken with impunity if it is to do with ME.

    Better people than me can tell you more about these things if you find it hard to believe; it is not a paranoid fantasy.

    Oh, and remember at all times that the stunning success of the GET trials is being touted to the MS society, the Arthritis Society, longcovid people and others as a treatment for fatigue. Certain people have an awful lot to lose if the review gives a true report.
     
    EzzieD, alktipping, Chezboo and 13 others like this.
  9. Trish

    Trish Moderator Staff Member

    Messages:
    53,405
    Location:
    UK
    @Hilda Bastian, thank you for reading our posts.

    There are two particular aspects of your report and this discussion that are keeping me awake at night:
    ________

    1. The appointment of a patient to be a member of the review author panel.

    I thought you were appointed to ensure patients' expertise on the research under review is fully included as part of the writing of the new review. I thought that meant you would do your best to ensure expert patients/carers were included as review authors. I thought that logically meant you would make recommendations on the basis of a track record of understanding of the research and and an appropriate level of expertise to make a meaningful contribution to the review process.

    I assumed that your decision process on who to recommend to sit on the review writing panel would include some combination of an open application process with the usual trappings of role decription, required skills, public announcement and a closing date, alongside a search of published literature on the subject to find patient/carer authors who might fit the role and could be encouraged to apply.

    What I have been shocked by is the idea that a trawl by you of the internet for a non activist, possibly who also met some secret criteria on their opinions about exercise (different from that of 'activists?), was considered the appropriate method of finding the sole patient to join the review writing panel. Can you see how very odd (to put it politely) that looks?

    As you are well aware, a systematic review of the research on a treatment, published in the name of a government funded high profile organisation like Cochrane, has surely to be seen to be carried out by a panel of individuals with the highest possible level of relevant expertise for the job. How on earth does being a 'non activist' patient specially qualify someone for this task?

    What particular contribution is a non-activist expected to make to the detailed examination of data that could not be fulfilled by an expert patient who also happens to have taken part in some activism? Does attending a silent vigil in a wheelchair disqualify someone? Or perhaps tweeting about the flaws in some research, or discussing it on a forum - is that a disqualification?

    I am lost. Even if my assumptions about an open application process were wrong, and that's not how Cochrane works, surely they look for appropriate knowledge and expertise in their review authors.
    _________________

    2. 'Pounding'

    You expressed, earlier on this thread, empathy when I said the decades of stigma, neglect and harmful medical advice many of us have suffered means some of us reach the stage of despair, that sometimes comes out as anger, when we see Cochrane being so unwilling to take seriously the reasons the current reviews of CFS treatments are unsound and harmful, and to take swift action to withdraw the review once the flaws were raised years ago by expert patients.

    I find it very hard to square that empathy with your accusation made, denied, and then repeated on this thread, of unspecified patient/carer 'activists' 'pounding' either Cochrane or you or the BPS researchers - I've lost track of which group you thought was under attack in an unreasonable and counterproductive way.

    I thought better of you than that. Surely you are not so naive as to buy into the BPS cabal's use of smearing tactics against patients as a way of deflecting criticism of their research. So why the innuendo and refusal to specify what you mean? By not specifying actions you deem unacceptable, you accuse us all.

    I feel very unnerved by this. Do you mean me? Has my, I think wholly justified, anger at Cochrane, or my criticisms of the opacity of the appointment process been seen as 'pounding'? You seemed to suggest this thread discussion includes some posts that are in some way problematic.

    I can see it's a pain when you thought you were acting reasonably to have some of your actions called into question by some members of the 'consumer' group you have been appointed by Cochrane to communicate with, and to be faced with a flood of posts questioning some of your decisions. I accept that you are under no obligation to respond here and now to the concerns we raise.

    But please, to help us all, to relieve the distress of those who feel accused, and to clear yourself of accusations of buying into the harassment narrative, please can you either be more specific about what you are referring to, or alternatively, retract the accusations of 'pounding'.
    _________________


    It would be good to clear the air on these issues so we can all return to focusing on the important and valuable role the IAG, and the good people on it, can play in the review, and the part we can play in feeding into that process when invited, our comments on the protocol and anything we are asked to participate in.

    I am sure we all want to make a constructive contribution, as we did to the NICE guideline draft consultation. I personally spent six weeks solidly working on our forum submission to NICE (with others) to the detriment of my health.

    This matters enormously to us all. I hope we can work constructively together on it.

    Edited: typo.
     
    Last edited: Jun 4, 2021
    Simone, lycaena, EzzieD and 25 others like this.
  10. Jonathan Edwards

    Jonathan Edwards Senior Member (Voting Rights)

    Messages:
    13,972
    Location:
    London, UK
    It looks to me as if the lead author for the new review will be a physiotherapist, Nicholas Henschke. That seems a bit crazy since the problems with the last review stem from having a physio as lead author. If you are a physio and you write a review of physio that says there is no evidence it works you will be blackballed from jobs and professional organisation officership pretty much for good. So quite apart from any problems with therapeutic zeal there is a huge competing interest problem here.

    Yes, it is useful to have people with practical experience, but not if they can only come to one conclusion.

    I know all about this because I did a Cochrane review with two podiatrists. The minor crime we committed was to recommend a treatment for heel pain that was not podiatric but medical. The senior podiatrist made a career in health care research. The junior one was vilified by his colleagues and felt very badly done by.

    It looks to me as if the decision on this will have come from the MOSS review group - the video for which is all political sound bites and no substance.



    I have not looked at this beyond the abstract but it does not look promising.

    Exercise reduces pain and improves physical function for people awaiting hip replacement surgery
    1. Nicholas Henschke1,
    2. Joanna Diong2,
    http://dx.doi.org/10.1136/bjsports-2013-092726
     
    Sid, EzzieD, Sean and 20 others like this.
  11. Caroline Struthers

    Caroline Struthers Senior Member (Voting Rights)

    Messages:
    884
    Location:
    Oxford UK
    Great. HAve you already looked at the Vink Vink-Niese re-analysis? https://journals.sagepub.com/doi/pdf/10.1177/2055102918805187. I think I suggested at some point that they be invited to Cochranize their work. I may not have done, but would that be considered once you and the IAG had read and analysed it? Of course they may not be willing to do that, but it seems a very logical solution.
     
    Simone, EzzieD, Sly Saint and 15 others like this.
  12. cassava7

    cassava7 Senior Member (Voting Rights)

    Messages:
    1,008
    The RCTs and reviews that Henschke has co-authored, which focus on chronic pain, seem to acknowledge low to very low quality evidence, but not enough in that most of those still recommend interventions for which only such poor evidence is available. Unfortunately, this is precisely the case of the current Cochrane review of exercise therapy for CFS.

    Efficacy and safety of pharmacological, physical, and psychological interventions for the management of chronic pain in children: a WHO systematic review and meta-analysis, Fisher et al., 2021

    Association of Therapies With Reduced Pain and Improved Quality of Life in Patients With Fibromyalgia: A Systematic Review and Meta-analysis, Mascarenhas et al., 2021

    Low back pain in children and adolescents: a systematic review and meta-analysis evaluating the effectiveness of conservative interventions, Michaleff et al., 2014

    Effect of Primary Care-Based Education on Reassurance in Patients With Acute Low Back Pain: Systematic Review and Meta-analysis, Traeger et al., 2015

    Interestingly, this last review is challenged by a RCT from the same team: Effect of Intensive Patient Education vs Placebo Patient Education on Outcomes in Patients With Acute Low Back Pain: A Randomized Clinical Trial, Traeger et al., 2019

    (And a small study that relates to the ongoing discussion of clothes worn by psychotherapists on S4ME: What you wear does not affect the credibility of your treatment: A blinded randomized controlled study, Traeger et al., 2017.)

    ETA: Henschke's work seems to show more sensitivity towards evidence quality than the previous authors team (Larun et al.), so hopefully he can acknowledge Todd Davenport and Mary Dimmock's explanations of the issues with the evidence base for exercise therapy in CFS.
     
    Last edited: Jun 4, 2021
    lycaena, Sly Saint, Sean and 12 others like this.
  13. Adrian

    Adrian Administrator Staff Member

    Messages:
    6,511
    Location:
    UK

    You are missing the point. The way things were phrased suggests a particular view point comming from groups of medics who attack ME patients. Simply changing the language later doesn't change this.

    But ultimately the question that needs to be answered is why have this split? What is the purpose and how does it relate the the necessary skill set to do the job. Ultimately it seems like quite a weird and perverse selection criteria and you have not given a justification of why it could be important.
     
    Simone, Kirsten, EzzieD and 14 others like this.
  14. Adrian

    Adrian Administrator Staff Member

    Messages:
    6,511
    Location:
    UK
    I was looking for trials he may have been involved in and here is a stats plan that he was involved in
    https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5537460/pdf/main.pdf

    They seem to be using a pain intensity scale as a primary outcome (along with an overly complex stats model). The intervention is an education program with a control group having a 'sham education program'. I'm not sure if that can be considered to be blinded or not but on a quick glance I would be concerned that he may have made similar mistakes to those involved in GET with his own research.
     
    Sean, alktipping, Michelle and 8 others like this.
  15. Jonathan Edwards

    Jonathan Edwards Senior Member (Voting Rights)

    Messages:
    13,972
    Location:
    London, UK
    It is an intriguing idea. But if you are testing whether or not an information package is valid then to assume it is 'education' and an alternative' sham education' begs a very big question. If the sham group had done better then presumably it would have been real education and the test sham.

    I find it hard to believe that you can do this with a straight face and retain blinding. It looks as if the trial was 'positive' on secondary measures only - which does sound familiar.
     
    Mithriel, Sean, alktipping and 9 others like this.
  16. Adrian

    Adrian Administrator Staff Member

    Messages:
    6,511
    Location:
    UK
    You would also need to ensure the sham education wasn't harmful which could mean it ends up not saying much and setting very different expectations but I've not dug into the material. But it doesn't suggest that he has a huge experience with well run trials.
     
    Mithriel, Sean, alktipping and 8 others like this.
  17. Hutan

    Hutan Moderator Staff Member

    Messages:
    27,829
    Location:
    Aotearoa New Zealand
    I find this quite a problem, thank you for highlighting these connections Hilda.

    Dr Newton is certainly not the first problematic researcher to be associated with patient charities. This is partly why we find ourselves where we are, although slowly things are improving. When we had so few researchers working on ME/CFS and there was less scrutiny of the methodology of their research I guess it was easy to be grateful for anyone who did any biological-sounding research at all.

    I think those two organisations urgently need to review Newton's body of work and consider if her association with them is helpful in achieving their aims. I can certainly understand that the effective endorsement her work by these two organisations could have led Hilda to assume Dr Newton would be an acceptable choice to ME/CFS patients and not look deeper into her work. It's really unfortunate.

    The credibility of those organisations might be damaged if the Cochrane exercise review ends up being anything less than a complete rejection of the BPS ME/CFS exercise trials as useful evidence. And, with the current composition of the writing team, where people like Dr Newton are effectively reviewing their own flawed work and biases, and the sole patient representative was selected largely on the basis that she has not expressed any concerns about ME/CFS exercise trials, I think we can be very sure that the Cochrane exercise review will not do what it needs to.

    Hilda, I'm left with the feeling that this review process is heading towards disaster. It is highly likely to end up eroding Cochrane's credibility further, promulgating harmful stereotypes of people with ME/CFS and causing collateral damage to organisations like AfME and MERUK. I understand you may feel that the process is now set in stone, but it has become clear that the bias in Cochrane runs too deep to run a useful review. If you really want to make things better for people with ME/CFS, the approach urgently needs to be rethought.

    In my previous career, I did quite a bit of work with organisations on reputational management. If I was advising Cochrane right now, I would be agreeing with @Caroline Struthers and others that the smartest move would be to withdraw the exercise review with minimal fanfare, and not attempt to replace it. The issue is just too contested for Cochrane, with its evident bias and lack of understanding of the issues, to manage successfully.
     
    Sid, Simone, lycaena and 25 others like this.
  18. rvallee

    rvallee Senior Member (Voting Rights)

    Messages:
    12,921
    Location:
    Canada
    This would have been the best case scenario, but that ship has sailed and it would frankly be unfair to the work already done, this is on an all-volunteer basis, unlike the never-ending flow of busywork funding and pompous self-awards that created this evidence base made entirely out of low-quality sophistry and statistical wizardry.

    Frankly this project is as much about Cochrane as it is about the review itself. So far the organization has been unable to acknowledge they have been anything but perfect and beyond any criticism, leaving others to clean up their mess, never did any better than a politician's insincere "I'm sorry I got caught" apology and swiftly walked it back once the public threats came pouring out from the likes of Gerada. This remains one rare opportunity for the mutual admiration society approach that rules evidence-based medicine to be challenged from within. Maybe.

    So much suffering would have been avoided if they had done the right thing, the obvious inevitable thing that will happen anyway.
     
  19. Invisible Woman

    Invisible Woman Senior Member (Voting Rights)

    Messages:
    10,280
    The setting of expectations is arguably one of the most important things in research.

    As a techie, I have spent an awful lot of what working life ME allowed me dealing with problems caused by previous companies and their engineers not managing client expectation.

    If two engineers go to do the same job for different clients and complete it to the same acceptable standard, I guarantee the engineer who sets and manages the customer's expectations will be perceived as doing the better job. in the company I worked for my line manager even gathered data on it as they followed up with customer satisfaction questionnaires.

    The expectations set between both arms will have a significant effect on how well those patients feel their treatment has worked for them.

    The type of questionnaires we have repeatedly raised concerns about can further enhance that effect.
     
    rvallee, Mithriel, MEMarge and 5 others like this.
  20. Hutan

    Hutan Moderator Staff Member

    Messages:
    27,829
    Location:
    Aotearoa New Zealand
    I just want to add to that, that this exercise review also has the potential to harm the reputations of those associated with it, including Hilda's. I'm particularly concerned that @Medfeb, a good ME/CFS advocate, might get caught in the crossfire, being expected to work a miracle with people on the writing team and in Cochrane itself who will not change their beliefs about the effectiveness of exercise for ME/CFS, and having to defend a result that is a political compromise rather than something that is soundly based and helpful to people with ME/CFS.

    A Cochrane exercise review still carries too much weight when national ME/CFS clinical care guidelines are made, for patient advocates to do anything but campaign against one that suggests that the current evidence-base supports exercise therapy as a treatment for ME/CFS.
     
    Simone, rvallee, MEMarge and 9 others like this.

Share This Page