Trial By Error: An Open Letter to Dr Godlee about BMJ’s Ethically Bankrupt Actions

I can't remember who said it, he was someone in the medical establishment at the time of the royal colleges report.

He said that ME was a new type of disease which was not physical or mental but held a strange position between the two.

I felt at the time that you would need extraordinary, conclusive proof for such a bold claim. I was very pleased to see an academic, Dr Hughes, making this point.

Of course, they have used the existence of this strange type of disease in ME to roll it out for lots of other ones now.
 
Northwestern University law professor and legal scholar Steve Lubet weighs in with his own letter to Dr Godlee:

Dear Dr Godlee: I am a legal ethicist, rather than a physician or scientist, so I will not weigh in on the various methodological and other problems that have been identified regarding "Clinical and cost-effectiveness of the Lightning Process.” I do want to comment, however, on one aspect of the “Correction” recently published in Archives of Disease in Childhood, which accepted “an assurance from the authors that the change in primary outcome was not influenced by (positive) findings in the feasibility phase.” Having spent many decades studying and evaluating conflicts of interest in both academic and professional settings, I find it extremely troubling that a respected scholarly journal would discount acknowledged research irregularities based upon such an obviously self-interested conclusion by the investigators themselves.

To put it bluntly, conflict of interest principles exist because it is impossible to rely upon affected individuals to provide objective assessments of their own decisions. In this instance, the “Lightning Process” authors have a quite evident stake in avoiding retraction of their article, which they only now admit “was not fully ICMJE compliant.” Thus, no matter how sincere they may be in defending their work, they should never have been the ones to determine whether the change in primary outcome had been influenced by their earlier positive findings.

In legal and judicial ethics, the applicable standard for disqualification is whether an individual’s "impartiality might reasonably be questioned." Let me kindly suggest that the standards of BMJ Archives of Disease in Childhood ought to be no less rigorous.

In this instance, the authors of the “Lightning Process” article cannot possibly appear impartial regarding the validity of their own study, much less the question of whether their outcome swapping had been influenced, consciously or otherwise, by the pre-registration findings. Applying the most basic conflict of interest principles, the decision to issue a correction, rather than a retraction, should not have been based, even in part, on the authors’ after-the-fact assurances.

Sincerely,

Steven Lubet
Williams Memorial Professor
Northwestern University Pritzker School of Law
Chicago IL 60611
Code:
https://www.facebook.com/david.tuller.1/posts/10156170275551829

 
Interesting point, of relevance to NICE members @adambeyoncelowe and @Keela Too.
It reminds me that Simon Wessely said to me that his only concern about PACE was that it would be followed by rolling out of 'CBT' done by subcontracted services using people who were inadequately trained.

Of course we have no idea who is 'adequately trained' here, emphasising the point that at present we have no idea what component, if any, of CBT is useful. It seems that psychologists assume that they can do it 'their way', which of course will work, even if trials are inconclusive.

I knew I remembered reading more about the planned referral and step up process for IAPT MUS (including CFS/ME). I have found the PDF on my laptop. The link to it is here:

https://www.uea.ac.uk/documents/246...ide-.pdf/55aea215-100e-4925-a968-65d6e89ad9b3

I'll put a link to it in a more appropriate thread when I have the mental energy, but am putting it here now as it will be of interest to those on the NICE group.

Tagging @adambeyoncelowe @Keela Too

Please tag any others who should see this (these are the only 2 names I know from memory)

May be of interest to @dave30th for background to the IAPT MUS agenda
 
Last edited:
Prof. Rebecca Goldin said:
To title the piece a “randomized controlled trial” is misleading as the participants were not randomly selected.
Just to be pedantic here, so I fully understand. I think Rebecca Goldin is saying that because half the full trial participants were rolled over from the feasibility study, then selection of the trial participants was not randomised; this is clearly true. But when talking about a RCT, is that the sort of randomisation the 'R' stands for? I thought it was about random allocation to the various trial arms?
 
Just to be pedantic here, so I fully understand. I think Rebecca Goldin is saying that because half the full trial participants were rolled over from the feasibility study, then selection of the trial participants was not randomised; this is clearly true. But when talking about a RCT, is that the sort of randomisation the 'R' stands for? I thought it was about random allocation to the various trial arms?

I'm not really sure what that means either. I wonder if Goldin is used to the term being used differently in another context? Ma6be she meant the participants are not from a random sample as they all volunteered (though that would be odd). The 'controlled' part of the title could be problematic given the poor control intervention.
 


Two more letters to Dr Godlee. The first is from Philip Stark, a professor of statistics at Berkeley. The second is from Robert Garry, a virologist at Tulane.

*****

Dear Dr. Godlee--

I hope you reconsider your decision.

Leaving this paper in place is a disservice to science and to public health--although it does provide a lovely [(negative) example for teaching ethics in science and illustrates how skirting proper statistical practice may lead to erroneous conclusions.

Regards,
Philip

*****

Dear Dr. Godlee,

I am writing to urge you to reconsider the decision to republish the pediatric study of the Lightning Process conducted by investigators from the University of Bristol and published in Archives of Disease in Childhood.

My own perspective is as a virologist, with a long-standing interest in chronic illnesses such as chronic fatigue syndrome. Although I am not a physician, I have met many individuals with these conditions, and have at least one family member that is afflicted. Chronic fatigue syndrome is nota state of mental confusion that can be corrected by the pseudo-scientific incantations of the Lightning Process.

I am sure that you are aware that the International Committee of Medical Journal Editors has stated clearly* that, “The integrity of research may also be compromised by inappropriate methodology that could lead to retraction.”

If there was ever an instance when there was “inappropriate methodology,” this is it.

My recommendation is immediately publish an “Expression of Concern” regarding this multiply flawed study in accordance with COPE guidelines.

I then urge you to consult with other experts outside of the Bristol sphere of influence and follow their guidance.

I am confident that an independent group of experts will come the very same conclusion as the distinguished group copied here - this manuscript must be retracted.

Very sincerely,

Robert F. Garry, PhD

Robert F. Garry, PhD
Professor, Department of Microbiology and Immunology
Assistant Dean, Graduate Program in Biomedical Sciences
Program Manager, Viral Hemorrhagic Fever Consortium
Director, Tulane Center of Excellence, Global Viral Network
Chief Scientific Advisor and Co-Founder, Zalgen Labs, LLC
Tulane University School of Medicine
New Orleans, LA 70118
 
I knew I remembered reading more about the planned referral and step up process for IAPT MUS (including CFS/ME). I have found the PDF on my laptop. The link to it is here:

https://www.uea.ac.uk/documents/246...ide-.pdf/55aea215-100e-4925-a968-65d6e89ad9b3

I'll put a link to it in a more appropriate thread when I have the mental energy, but am putting it here now as it will be of interest to those on the NICE group.

Tagging @adambeyoncelowe @Keela Too

Please tag any others who should see this (these are the only 2 names I know from memory)

May be of interest to @dave30th for background to the IAPT MUS agenda
A recent Scandinavian study concluded that irritable bowel syndrome (IBS) alone, incurs substantial direct and indirect costs corresponding to a share of up to 5% of the national direct outpatient and medicine expenditures
Riiiiiight. Oh, for sure.

Between 20% and 30% of consultations in primary care are with people who are experiencing MUS and have no clear medical diagnosis.
Yes, diagnosis is hard, in fact by far the hardest part of medicine. A diagnostic process that takes 10 consults will have 9 concluding no clear diagnosis. What kind of idiot could be confused by this fact? Oh, wait, I'm answering my own question here.

It's also a common attitude to not make a diagnosis of ME or other contested diseases based on a belief that giving it a label is "harmful", further artificially inflating this statistic by deliberately making some consults conclude without a diagnosis, then pointing at this arbitrary refusal as evidence of how common MUS are. This is an ouroboros of error, where past failure is used as evidence for future failure.

The list of names on the committee that produced this document says it all. Moss-Morris, Chalder, White. It's a purely speculative opinion paper about things they wish to be true. What a weird group of people.
 
Last edited:
Did you not spot the names 'Chalder' and 'White' on the member and special advisor list?
Hehe, yeah I added it in an edit. Moss-Morris as chair basically makes the process a mockery anyway and the citations are basically a giant circle jerk of self-citation and self-congratulation.

This isn't serious work, it's a wishlist to the universe, if things were as they believed this would be a roadmap but instead they reject reality and substitute their own. But it's being put into practice with no safeguards or monitoring or feedback process or any of this! Madness.
 
But it's being put into practice with no safeguards or monitoring or feedback process or any of this! Madness.

It (IAPT LTC and IAPT MUS) is being imposed on every Clinical Commissioning Group across England (by NHS England) - even though many are in financial crisis. I wonder if this is a contributing factor to why journal editors and Cochrane are trying so hard to avoid retracting the relavant trials (including the LP one) and reviews, and why they are not making the corrections that DT keeps pressing for.
 
Last edited:
But it's being put into practice with no safeguards or monitoring or feedback process or any of this! Madness.

'Technically' there will be 'monitoring of outcomes and targets', but these have been very cleverly devised to give the appearance of 'over 50% recovery' in keeping with the standard IAPT agenda for anxiety and depression (as have been discussed on other threads). With regard to 'CFS/ME' the 'improvement' will be measured using the Chadler Fatigue Scale. Why do you keep referring to a 'circle jerk'? I have no idea what you mean...
 
Dave blogs the three latest letters (that have been shared already on Facebook and posted above).
I have posted a batch of letters about the Lightning Process study that have been sent to Dr Fiona Godlee, editorial director of BMJ, here, here and here. I have been impressed with how direct these scientists and clinicians have been in expressing their dismay at BMJ’s failure to adhere to its own editorial standards. I get the feeling some of the writers have been inspired by the earlier messages to Dr Godlee.

Anyway, here are three more: from Steven Lubet, a law professor at Northwestern University in Chicago; Robert Garry, a microbiology professor at Tulane University in New Orleans; and Philip Stark, a statistics professor at UC Berkeley. Thanks to all of them for their support. That makes 14 letters so far.
http://www.virology.ws/2019/09/16/t...of-letters-to-dr-godlee-on-bjs-lp-study-mess/
 
Back
Top Bottom