Cochrane Review: 'Exercise therapy for chronic fatigue syndrome', Larun et al. - New version October 2019 and new date December 2024

Discussion in 'Psychosomatic research - ME/CFS and Long Covid' started by MEMarge, Oct 2, 2019.

  1. MSEsperanza

    MSEsperanza Senior Member (Voting Rights)

    Messages:
    2,997
    Location:
    betwixt and between
    Yes, probably they didn't realize. Which underscores how misleading it is.
    Thank you and also to those who reacted on Xitter.

    Yes, and they have more than 90.000 followers on X. Many German-speaking physiotherapists, including those teaching at colleges, seem to like what they have to offer.
     
    Last edited: Dec 20, 2024
  2. Caroline Struthers

    Caroline Struthers Senior Member (Voting Rights)

    Messages:
    1,019
    Location:
    Oxford UK
    Have replied to their Tweet
     
  3. ME/CFS Skeptic

    ME/CFS Skeptic Senior Member (Voting Rights)

    Messages:
    4,199
    Location:
    Belgium
    I also have a 2019 version that does not include the editorial note with a link to the update process, even though it includes all the rest of the version history, all the way back to 2004. The latest update mentioned is this:

    upload_2024-12-20_11-55-5.png
     
    Kitty, Binkie4, alktipping and 4 others like this.
  4. ME/CFS Skeptic

    ME/CFS Skeptic Senior Member (Voting Rights)

    Messages:
    4,199
    Location:
    Belgium
    Wasn't there some rule that if a review is substantially out of date, the editors can put a warning sign to it? Like they did with the 2008 review of CBT for ME/CFS. It says:
    https://www.cochrane.org/CD001027/DEPRESSN_cognitive-behaviour-therapy-chronic-fatigue-syndrome

    The Larun et al. review is now also no longer maintained, with the latest search done 10 years ago.

    Maybe @Caroline Struthers knows more about this procedure?
     
    Sly Saint, EzzieD, Hutan and 12 others like this.
  5. Nightsong

    Nightsong Senior Member (Voting Rights)

    Messages:
    864
    Hutan, Sean, alktipping and 5 others like this.
  6. Peter Trewhitt

    Peter Trewhitt Senior Member (Voting Rights)

    Messages:
    4,468
    A selection from the Cochrane policy guide for when editorial notes can be used (sorry formatting was the best I could manage):

    It seems all are a possibility given
    • the Editor in Chief could act if she wished
    • there are problems with the review in terms of failure to address bias and failure to report harms, is out of date based on evidence prior to 2011, etc
    • there is a more recent fuller review of the evidence that supersedes this review, namely that contained in the new NICE guidelines in the ME/CFS 2021 guidelines
    However I doubt Cochrane would consider any grounds to add a further note that did not suit their BPS favourites.
     
    Hutan, Sean, alktipping and 4 others like this.
  7. Trish

    Trish Moderator Staff Member

    Messages:
    57,091
    Location:
    UK
    Quoting from this guide to adding editorial notes:
    ____________________

    Decisions and communication
    Before requesting publication of an Editorial note, take the following steps:

    • consult the Editorial notes policy above;
    • determine the type of Editorial note required; and
    • contact Cochrane Support (support@cochrane.org) to seek prior approval from the Research Integrity team.
    After publishing an Editorial note, Cochrane Support will notify David Hives at Wiley (dhives@wiley.com) with a link to the review or protocol.

    Following notification, David will

      • manually update the PubMed version of the article (the Editorial note will display witihin 24 hours of the update), and
      • if the full text of the review is on PubMed Central (PMC), send the Editorial note to PMC Support, who will update the PMC version of the article (this can take up to two weeks).
    Specifications for publishing and display
    Editorial notes are created and managed in RevMan using the Published notes section. For details on how to add or edit an Editorial note, see the RevMan knowledge base.

    Editorial notes are published as part of a standard publication workflow. To add an Editorial note to a published review – making no other changes to the review – use the 'Amended' What's new event (no new citation) (see Dates and events in RevMan Knowledge Base for implementation instructions). During the publication process, the Editorial note is extracted from the published notes and displayed separately.

    When published, the Editorial note will display in the Cochrane Library as a text box above the abstract online and in the PDF version, and above the Plain Language Summary on https://www.cochrane.org/evidence. As noted above, Cochrane Support will contact Wiley to initiate manual changes to the PubMed and PubMed Central version(s) of the article.
    ____________
    End of quote, more at link.


    That seems to make it clear that if all that is changed is adding a new editorial note, it should be added to the existing review with no new citation. I think that means you shouldn't pretend a review is new just because it has the new note added, nor should you change its publication date.

    Cochrane lists the 2024 version as version 9, the 2019 version as version 8, in other words, they have given it a new citation.

    https://www.cochranelibrary.com/cdsr/doi/10.1002/14651858.CD003200.pub9/information#history

    It also says the Research Integrity Unit has to approve it. I wonder whether they approved changing the date and calling it a new version of the review.
     
    Last edited: Dec 21, 2024
    Hutan, Sean, alktipping and 7 others like this.
  8. Caroline Struthers

    Caroline Struthers Senior Member (Voting Rights)

    Messages:
    1,019
    Location:
    Oxford UK
    That warning on the CBT review took me a lot of to-ing and fro-ing to secure. It was I think a last ditch attempt to get me off their back rather than something that is routinely done when reviews are badly out of date. I did ask them to put a similar note on all out of date reviews but, funnily enough, they said no. It was shortly after this note was put on the CBT review that the CEO Mark Wilson left Cochrane abruptly, but I think he stepped down mainly because the NIHR stopped funding UK Cochrane Groups on his watch. I will dig out the correspondence as I don't think I posted it on my blog. But this is the letter from MW sent to me days before he left Cochrane which mentions the note
    https://acrobat.adobe.com/id/urn:aaid:sc:EU:03ca6e6b-ffe8-4e28-aa7b-74ec15f19459
     
    Ash, geminiqry, Sly Saint and 16 others like this.
  9. Medfeb

    Medfeb Senior Member (Voting Rights)

    Messages:
    607
    I have an October 2019 version and am seeing the same thing as @MCFS
    I have an Oct 3, 2019 PDF of the 2019 review and am seeing the same thing as @ME/CFS Skeptic - no editorial note and the most recent amendment is dated August 8, 2019.

    The citation in the Oct 2019 PDF is listed as follows, which is the same as in the current PDF of the 2019 review (here).
    "Larun L, Brurberg KG, Odgaard-Jensen J, Price JR. Exercise therapy for chronic fatigue syndrome. Cochrane Database of Systematic Reviews 2019, Issue 10. Art. No.: CD003200. DOI: 10.1002/14651858.CD003200.pub8."​

    But the publication dates in these two PDFs are not the same:
    My 2019 version - "Publication status and date: Edited (conclusions changed), published in Issue 10, 2019."
    The current version - "Publication status and date: Edited (no change to conclusions), published in Issue 3, 2021."

    And the "What's New" sections are different. For the Oct 3, 2019 PFD, there are 2 entries dated August 8, 2019 while in the current version, there's just one entry dated March 18, 2021. From August 8, 2019 to March 18, 2021 inclusive, there are 8 distinct dates of amendments. So does this suggest they are releasing a different version of the 2019 review for at least some of these different dates?

    As an aside, the online version of the publication history (here) does not include the August 8, 2019 amendments. An error in maintaining the revision history for online purposes? the format is not the same as in the PDF so it looks like something being maintained separately
     
    Kitty, bobbler, alktipping and 5 others like this.
  10. ME/CFS Skeptic

    ME/CFS Skeptic Senior Member (Voting Rights)

    Messages:
    4,199
    Location:
    Belgium
    Yes I found this confusing.

    For the 2017 Apr 25 update they mention revisions from 2017 May 05, all the way up to 2019 Jun 17. This seems like an error because all these changes came after the April 2017 update?

    And for the 2019 Oct 02 update the revision dates go from 2020 Feb 06 to 2021 Mar 18. It doesn't mention the 8 August 2019 changes that explain why an amendment was made. That part seems to left out of the version history on the Cochrane website.
     
    Kitty, bobbler, Hutan and 3 others like this.
  11. ME/CFS Skeptic

    ME/CFS Skeptic Senior Member (Voting Rights)

    Messages:
    4,199
    Location:
    Belgium
    So the 2019 version that I had, that was published shortly after the amendment says (my bolding):
    While the 2019 version that is now on the Cochrane website says (my bolding):
    So It seems that they have the exact same DOI and citation but that there are (at least) two versions: one from 2019 without the editorial note and one from 2021 that has the editorial note.

    In other words, they did not create a new citation and publication for the first editorial note that announced an update of the review. But they did so for the editorial note that announced this update is cancelled?
     
    NelliePledge, Amw66, Kitty and 15 others like this.
  12. Trish

    Trish Moderator Staff Member

    Messages:
    57,091
    Location:
    UK
    I have tried to clarify this with Hilda Bastian on her talkpage:

    She replied:
     
    Ash, Kitty, bobbler and 17 others like this.
  13. rvallee

    rvallee Senior Member (Voting Rights)

    Messages:
    14,080
    Location:
    Canada
    Ah, yes, the Air Bud excuse: Ain't no rule that says a dog can't play basketball. Very serious stuff. Bastian still shilling for Cochrane pretty much says everything.
     
  14. Trish

    Trish Moderator Staff Member

    Messages:
    57,091
    Location:
    UK
    I think Hilda is just pointing out the policy seems to be ambiguous.
     
    Ash, Yann04, EzzieD and 9 others like this.
  15. Sly Saint

    Sly Saint Senior Member (Voting Rights)

    Messages:
    10,134
    Location:
    UK
    "Updating Cochrane reviews
    An update of a Cochrane review must involve a search for new studies."

    Editorial policies | Cochrane Library

    eta: this clearly didn't happen
     
    Last edited: Dec 23, 2024
    ukxmrv, Ash, Sean and 15 others like this.
  16. Trish

    Trish Moderator Staff Member

    Messages:
    57,091
    Location:
    UK
    More from this link:

    This has not happened with the Larun review, for example Michiel Tack's 2020 comment which detailed multiple problems with the review and which was reponded to with an editors letter saying it would be addressed as a priority in the new review - hasn't happened because the new review process has been cancelled.

    The 2024 and earlier listed items in the history are described as 'version', not as updates. It's very confusing.

    Nope, me neither. The total reversal of announced need for a new review to rejection of any changes and publication as a new 'version' is incomprehensible to me. It seems to be completely contrary to Cochrane's own policies.

    I have highlighted the basis on which we argued that the review should be withdrawn.
    I don't understand the bit about withdrawal generating a new review that I've bolded.
     
    Ash, Sean, alktipping and 10 others like this.
  17. forestglip

    forestglip Senior Member (Voting Rights)

    Messages:
    1,410
    They responded and basically told me to take it up with Cochrane. And it looks like their tweet is still up.

     
    Ash, Sean, alktipping and 7 others like this.
  18. Hutan

    Hutan Moderator Staff Member

    Messages:
    30,783
    Location:
    Aotearoa New Zealand
    I think there's an issue with Cochrane being both a journal publisher and a 'provider of 'gold standard' medical advice'. If a review is published and then deemed to be not only not gold standard medical advice but a potential source of harm etc, it can be withdrawn as a Cochrane review, but it still exists. It's quite a mess, and I don't understand how a new DOI can be created either. Presumably the review could have been cited in other papers, so changing the DOI would stuff up those citations?
     
    ukxmrv, Ash, Sean and 7 others like this.
  19. Peter Trewhitt

    Peter Trewhitt Senior Member (Voting Rights)

    Messages:
    4,468
    If you go to the old citation Larun et al (2019) is still there but at the top in red (if my memory serves me) is a note to say this is not the most recent version and a link to the identical Larun et al (2024).
     
    Ash, alktipping, LJord and 6 others like this.
  20. Trish

    Trish Moderator Staff Member

    Messages:
    57,091
    Location:
    UK
    I wonder whether all this relatively new stuff that restricts how reviews can be withdrawn was done specifically to scupper withdrawal of the Larun review, and the bit about being replaced by a new review was to tie withdrawal to a new review being approved. Bingo, drag out a new review process, then cancel it for fake reasons, and Larun can keep on being republished every 5 years unchanged for ever.
     
    Michelle, NelliePledge, Ash and 11 others like this.

Share This Page