Who Agrees That GRADE is (a) unjustified in theory and (b) wrong in practice?

Discussion in 'Other research methodology topics' started by Jonathan Edwards, Mar 4, 2021.

  1. bobbler

    bobbler Senior Member (Voting Rights)

    Messages:
    3,734

    Thank you for clarifying and attaching.

    Oh wow. Reading from the bottom-up as this is chronological just wow. What a read (and I've only scanned so far). And very clear it seems when you begin with that first email noting the clear result doesn't equal conclusion drawn issue. This kind of shows it all - everything on everything encompassed in one big email trail as a CFS 'issues' microcosm.

    Says it all really doesn't it?
    "Dear Gordon,
    Many thanks for your willingness to arbitrate and help to resolve the disagreement
    between Cochrane’s Editorial and Methods Department and the authors of the Cochrane
    review."

    There is a very 'pushy' advocacy for 'the authors' to the point I assumed they were the authors until I read the above quote?

    I can't help but note the difference between his recommended arbitration of:

    And Atle's:

    Isn't that last line proposing the opposite to requiring it is 'highlighted' they have not established an important effect, but instead agreeing to 'not mentioning' effect size?

    Now you've let me know the connection on who is hosted by who (institutions) it's interesting experience/context/etiquette to apply when reading the abrupt difference between these two in the email trail. Makes it seem read between the lines responses (familiar to me what these mean particularly when they are people of different power levels or communicating from/for someone on a bigger power level etc), rather than misunderstanding or just exhaustion, could be involved?

    And where did the drop-outs get lost in that attrition-by-email?
     
    Last edited: Oct 20, 2022
  2. bobbler

    bobbler Senior Member (Voting Rights)

    Messages:
    3,734
    and @Wonko New post by Caroline with documents of the email trail here. 28 pages of emails, earliest one at the bottom Ie page 28

    Even a scan is interesting from this point upwards, as I feel it pretty much starts to shed light on this 'curiosity'
     
    Last edited: Oct 21, 2022
    alktipping, Sean and Peter Trewhitt like this.
  3. Caroline Struthers

    Caroline Struthers Senior Member (Voting Rights)

    Messages:
    966
    Location:
    Oxford UK
    This is exactly it. Guyatt said they should be required to highlight there is no important effect. And they told Karla they would take out any mention of effect size. That of course is not the same thing. And they got away with it.
     
    alktipping, FMMM1, Sean and 7 others like this.
  4. bobbler

    bobbler Senior Member (Voting Rights)

    Messages:
    3,734
    That's where 'it' happened. And I think it happened twice if the bit at the bottom about a potential switcheroo in the order of the docs from 14th June is correct. His question/response to all was ignored on the Fri by all too, then his Sat response was ignored - he was cut out of the email trail by Karla on Mon - and one line taken/caveats ignored.

    He got cut out of being copied in on that penultimate email [where the caveats aren't mentioned, instead a different question pretends to proxy it] sent straight after Guyatt's reply [which is basically about emphasising these caveats].

    Given all were copied in on Guyatt's reply (Saturday) and Karla copied only the first line without the caveats two days later to Atle who had received not only Gordon's email (noting the caveats) but also was asked but did not answer the question in the email on Friday.

    and then last email. I don't know if the timestamp would have different countries or anything but it looks like this reply was within 20mins.


    I'm very intrigued by the timestamps because on the emails before that (where there is a lot of between the lines language, like saying several times in one email 'we are happy to stand by your judgement) if these are all correct on the same time zone then the 14th June ones are in the wrong order on the trail of documents (11am has been placed in front of 9am).

    This is actually important - because in the right time order according to timestamps it shows Guyatt's question to Atle was in response to Karla's request to mark it moderate. This direct question seems it was ignored by both Karla and Atle all day Friday (despite all the talk of them being in a rush)

    so Guyatt then had to reiterate the caveats (which he did swiftly on a Sat - but Karla only did something with two days later), which were then ignored. At that point Karla cut him and his caveats out of the email trail to send her cut-down question to Atle.

    I can't help but ask what could have taken place offline Fri-Monday.
     
    Last edited: Oct 22, 2022
  5. MSEsperanza

    MSEsperanza Senior Member (Voting Rights)

    Messages:
    2,947
    Location:
    betwixt and between
    Last edited: Dec 3, 2022
    Hutan, Sly Saint, Lilas and 5 others like this.
  6. Caroline Struthers

    Caroline Struthers Senior Member (Voting Rights)

    Messages:
    966
    Location:
    Oxford UK
    Time to send my complaint to Cochrane
     
    Hutan, Sly Saint, bobbler and 6 others like this.
  7. MSEsperanza

    MSEsperanza Senior Member (Voting Rights)

    Messages:
    2,947
    Location:
    betwixt and between
    Not sure about posting links to other forum's dicsussions; also only skimmed yet, but thought this forum on statistics ( discourse.datamethods.org ) was interesting, and they also discussed some critique of GRADE:

    Article: Going from evidence to recommendations: Can GRADE get us there? - research methods / meta-analysis - Datamethods Discussion Forum

    https://discourse.datamethods.org/t...o-recommendations-can-grade-get-us-there/5445
     

Share This Page