PACE trial TSC and TMG minutes released

Discussion in 'Psychosomatic news - ME/CFS and Long Covid' started by JohnTheJack, Mar 23, 2018.

  1. Daisymay

    Daisymay Senior Member (Voting Rights)

    Messages:
    686
    Thanks, would it be normal to have an Analysis Strategy Group? And if so why wouldn't they not have been mentioned earlier in say in the protocol?

    I wonder when they came into existence, at the beginning or when they realised they needed to work out how on earth they could come up with seemingly positive results?
     
    MEMarge, janice, Woolie and 5 others like this.
  2. Trish

    Trish Moderator Staff Member

    Messages:
    55,414
    Location:
    UK
    In my simplistic ignorant mind, planning the analysis would have all been done at the same time as writing a detailed protocol and before getting ethical and funding approvals and starting to recruit patients.

    They had to do some dummy calculations anyway to work out what sample sizes they needed in order to get robust results.

    Surely the thing to do at that stage would be to plan what analysis would be appropriate to test whether their primary and secondary outcome measures were significant, and what boundaries they would set for each measure and a combined measure to represent clinically significant improvement, recovery and cost effectiveness.

    They could have computer simulated the whole thing and had the statistical analysis plan ready to run as soon as the real data was unblinded and collated.

    Well, that's what I'd do anyway, but what do I know.:(
     
    MEMarge, janice, Woolie and 13 others like this.
  3. JohnTheJack

    JohnTheJack Moderator Staff Member

    Messages:
    4,789
    I'd always thought that his vigorous support for the trial had come after its publication, once the journal was invested in the paper. It seems he was onboard from much earlier.

    It is strange. I think it goes back to the PR the BPS crowd had been running. They clearly had already convinced many, including Horton, that PACE was a slam-dunk and going to prove right what they had been saying for years.
     
    MEMarge, janice, Woolie and 17 others like this.
  4. JohnTheJack

    JohnTheJack Moderator Staff Member

    Messages:
    4,789
    Yes, that's how it seemed to me. Good post, thanks.
     
  5. JohnTheJack

    JohnTheJack Moderator Staff Member

    Messages:
    4,789

    The ASG is named:
    The analysis strategy group, chaired by MS, consisted of HLB, TC, JCD, KAG, ALJ, LP, PDW, and RW. The statistical analysis plan was written by the analysis strategy group and approved by the trial steering committee and data monitoring and ethics committee before the analysis was started.
     
    Last edited: Nov 19, 2018
  6. Adrian

    Adrian Administrator Staff Member

    Messages:
    6,563
    Location:
    UK
    I agree, I think things should move to the analysis being pre-coded so that as the last data is added to the database then the results tables would be produced.

    The PACE people seemed to have trouble 'cleaning data' so applying certain checks on the data can be helpful to detect possible errors.
     
  7. Adrian

    Adrian Administrator Staff Member

    Messages:
    6,563
    Location:
    UK
    When they were looking to raise the SF36 score acceptable for recruitment the PACE PI's understood just how subjective the questionnaires were. (Just not when used for results)

     
    MEMarge, janice, Woolie and 18 others like this.
  8. Sly Saint

    Sly Saint Senior Member (Voting Rights)

    Messages:
    9,924
    Location:
    UK
    Sorry if this is not the right place to put this but it was posted at the other place and thought it was relevant.
    SW always insists he had 'nothing to do with the PACE trial'
    upload_2018-3-24_15-49-19.jpeg
     
    MEMarge, Moosie, TigerLilea and 13 others like this.
  9. Lucibee

    Lucibee Senior Member (Voting Rights)

    Messages:
    1,498
    Location:
    Mid-Wales
    Keith noted this from meeting 16: https://twitter.com/user/status/977494101959565314


    My question would be: Is there a safe way to do the step test in people with ME/CFS, given that it exercises to exhaustion? It's probably a reasonable objective measure because it doesn't allow the subject to pace themselves.

    I'm presuming the step test they used is similar to this: https://en.wikipedia.org/wiki/Harvard_step_test
     
    MEMarge, janice, CarolB and 9 others like this.
  10. Jonathan Edwards

    Jonathan Edwards Senior Member (Voting Rights)

    Messages:
    15,175
    Location:
    London, UK
    No, I agree with Trish that it is very odd for there to be an Analysis Strategy Group in existence after the trial has formally commenced. By 2000 it was very clear to people running trials that your analysis needed to be decided before you started. It rather looks as if the MRC fell well below basic standards on this in its 'CTU'.

    More and more the message from this trial is not so much that the authors were incompetent but that the MRC was incompetent in its role as a guiding influence.
     
    Esperanza, MEMarge, janice and 15 others like this.
  11. Jonathan Edwards

    Jonathan Edwards Senior Member (Voting Rights)

    Messages:
    15,175
    Location:
    London, UK
    In the radio recording that someone uploaded here a while back Horton says the trial was eagerly awaited. It was clear from his tone that he knew well in advance that he was expecting a slam dunk trial.

    I think this has to confirm the suspicion one has always had that the editorial policy at the Lancet was little more than mingling with the in-crowd and picking up what was a hot favourite. Again, in this regard the Lancet falls way below peer review standards in regular specialist journals like Arthritis and Rheumatism or indeed New England Journal of Medicine. One always suspected that but one did not often have the chance to see it in action.
     
    Esperanza, MEMarge, janice and 23 others like this.
  12. Daisymay

    Daisymay Senior Member (Voting Rights)

    Messages:
    686
    So from TMG meeting 4, 23rd January 2004:

    "7. Trial Steering Committee (TSC): Final Membership and Date of 1st Meeting

    The MRC have confirmed approval of the membership. REDACTED, who is the director of the Clinical Trials Unit at the MRC, has agreed to chair the TSC. REDACTED has vast experience of clinical trials.... "

    Does that therefore mean that REDACTED here is Wessely?

    Does he really have "vast experience of clinical trials" ??
     
  13. Indigophoton

    Indigophoton Senior Member (Voting Rights)

    Messages:
    849
    Location:
    UK
    Not just Horton. The DWP provided some of the funding on the expectation that the trial would show CBT and GET to be successful. When asked why they funded PACE, they replied,
    https://www.whatdotheyknow.com/request/part_funding_of_the_pace_trial_b
     
  14. Lucibee

    Lucibee Senior Member (Voting Rights)

    Messages:
    1,498
    Location:
    Mid-Wales
    No. Janet Darbyshire was Director of the MRC CTU in 2004, I think. Wessely's CTU was at Kings.
     
  15. Jonathan Edwards

    Jonathan Edwards Senior Member (Voting Rights)

    Messages:
    15,175
    Location:
    London, UK
    There are sentences on the net looking very like the one @Daisymay quoted where the name is Wessely. He was certainly director of the CTU responsible for PACE as far as I can see, at least at some point. What is not clear to me is whether this is the entire MRC CTU or whether it is a subsection.
     
  16. Jonathan Edwards

    Jonathan Edwards Senior Member (Voting Rights)

    Messages:
    15,175
    Location:
    London, UK
    Yes, I think the role of DWP is fairly well documented. The question is where Horton comes in if he is supposed to be an independent editor publishing purely on scientific merit. Why was he eagerly awaiting such a scientifically boring trial?
     
    janice, pteropus, Adam pwme and 13 others like this.
  17. Lucibee

    Lucibee Senior Member (Voting Rights)

    Messages:
    1,498
    Location:
    Mid-Wales
    *cough* I think it says more about the expectation that the more prestigious the institution and affiliations (and numbers of gongs on the byline), the more robust the research will be. I think The Lancet takes it way too much on trust that things will be done properly under those circumstances.

    "It was a very easy trial to publish" because they felt they didn't need to do any checks. In my view, the more profs on the byline, the more scrutiny they should employ, since all the annoying pedantic juniors like me won't have been involved! It's airline safety protocols all over again.
     
  18. Jonathan Edwards

    Jonathan Edwards Senior Member (Voting Rights)

    Messages:
    15,175
    Location:
    London, UK
    That is the more charitable reading. I don't actually think it has to do with institutional prestige and affiliations. How did Andrew Wakefield get to be published? The Royal Free surgery department was hardly high profile. Horton did not come sniffing around when I was about to publish in NEJM from perhaps the most prestigious clinical science faculty in the world at the time - I guess because I did not go around touting my wares to chummy editors.
     
  19. Barry

    Barry Senior Member (Voting Rights)

    Messages:
    8,420
    You typically eagerly await something when you are already primed up for it being likely to be what you want it to be. Primed how and by who?
     
    MEMarge, Moosie, janice and 5 others like this.
  20. Jonathan Edwards

    Jonathan Edwards Senior Member (Voting Rights)

    Messages:
    15,175
    Location:
    London, UK
    Well, somebody here ought to know. People here seem to know everything! Or they soon enough find out.

    I can think of some candidates.
     

Share This Page