A small study with a standout result might be enough, or it might need replication first. Either way, if it's clear enough, it's possible it could compete pretty well via the normal funding programmes.
This is fascinating and promising-looking stuff and even I understood it!
What worries me about the funding is if a researcher is on a fixed-term contract and has to put in a new application to follow up a result - the time-gap might be enough to force them to take a different job. I hope the charities will speedily support this work if it comes up with a positive result.
Thanks much @Simon M
I particularly liked the part
“And what if the original findings don’t replicate?”
This is helpful management of expectations.
I guess we have had so many studies where they looked for stuff in the blood/plasma, and to date they haven’t really found anything outstanding (like an antibody) I might be in the less optimistic camp.
Great blog Simon, thanks. Sounds like a useful and worthwhile study.
The original Norwegian study was published back in 2016. I wonder why the Norwegians never replicated it themselves.
If Tronstadt helps them with methodology, is this attempt of replication an 'independent' replication? All in all, this still looks like a sound approach. I also like that the researchers have the right kind of skin in the game.
And that is why it was such a pleasure talking to you and Audrey. You are going about this in a rigorous way aiming to find ut if something is real or not. Sadly, that is not the norm.We're trying our best to make sure it's a success - which to us means to generate a solid piece of evidence that can really point to whether the 'factor in the blood' is real or not. Then to go on from there.
...and as we see it a negative result is also an informative outcome. We deserve to know one way or another.
Another reason to be impressed. One problem with repelication is that the repeat study may have changed the method is small but significant ways, and this minimises the risk.We're using the methodology they use in their 2016 paper of course, it's a replication after all. We're designing our specific plans and carrying out this work ourselves, on a different cohort, in a different lab with different equipment. As it's come up, we might run these plans by Karl if he wants to/ has time. It can only be improved by doing this.
Ah, I hadn't clocked that.- It could be the absence of something that is present in the healthy blood
Yes good management of expectations, and as we see it a negative result is also an informative outcome. We deserve to know one way or another.
Yes, lots of studies looking for differences in the blood in the form of proteomics/metabolomics, ELISAs and so on, but not to specifically look for blood factors that are causing an experimental result such as this one.
It's conceivable to me that this hasn't been done due to a lack of resources. Separating the blood into various fractions based on size etc is not difficult in itself, but it requires you to rerun the assay every time with each fraction which could get costly and time consuming depending on the assay. The seahorse that we're using for example requires something like 9-15 replicates per sample so is possibly not the ideal assay for actually searching for the factor.
As for the factor itself, there's various possibilities for what the nature of it might be.
- It could be a single protein/protein complex or some other molecule (which you might expect (prote)omics to have picked up in the past).
- It could be a modified protein eg phosphorylated/cleaved (which proteomics is likely to miss)
- It could be the absence of something that is present in the healthy blood
- It could be multiple proteins/molecules that either work in concert or redundantly, which may also vary between patients but still leading to the same endpoint.
Audrey spoke with Karl Tronstadt at some point last year about this and other things. It's not my place to relay what he said but I think it's probably fine to say it's simply something that they haven't done, there's no concerning reason.
We're using the methodology they use in their 2016 paper of course, it's a replication after all. We're designing our specific plans and carrying out this work ourselves, on a different cohort, in a different lab with different equipment. As it's come up, we might run these plans by Karl if he wants to/ has time. It can only be improved by doing this.
Thank you for your insights, @chillier !
Have you considered using PEM samples for your projects and to compare them?
I can not really say a lot about it, but I have funded some proteomics work (with a very small sample size; results remain unpublished so far) in the past, and the conclusion was that without 'good day vs. bad day samples' they would have been unable to find any (potential) signal.
If you have the option, it might be advisable to use PEM samples, at least in a subset of your cohort. You could either use Moreaus's PEM inducing technique or just ask patients to get blood drawn when they have PEM, if a more standardized approach is out of reach.
I don't know whether or not Tronstadt controlled for PEM, but either way, not controlling for it could make readouts less reliable?
Thank you for your work.
There's also a couple of collaboration with the Netherlands that are working on it as well but I agree that I wonder why they didn't do it themselves before. I'm not sure how costly it is.Apparently, Karl Tronstadt, who was the senior author and played a key role in the original experiment, has helped them with methodology, which suggests it's not something the Norwegians have given up on.
It's great to see this response to Charlie and Audrey's work, and thanks for the kind words about the blog.
Thank you for your insights, @chillier !
Have you considered using PEM samples for your projects and to compare them?
I can not really say a lot about it, but I have funded some proteomics work (with a very small sample size; results remain unpublished so far) in the past, and the conclusion was that without 'good day vs. bad day samples' they would have been unable to find any (potential) signal.
If you have the option, it might be advisable to use PEM samples, at least in a subset of your cohort. You could either use Moreaus's PEM inducing technique or just ask patients to get blood drawn when they have PEM, if a more standardized approach is out of reach.
I don't know whether or not Tronstadt controlled for PEM, but either way, not controlling for it could make readouts less reliable?
Thank you for your work.
Echoing this thank you everybody for your kind words
Not for this project. We recruited/collected from Sheffield with our collaborator Caroline Dalton and prioritized getting as large a sample size as we could over selecting for whether they were currently in PEM or not. We anticipate that there might be more variance in the ME cohort than the healthy controls and PEM could be a part of that heterogeneity - amongst other things. We collected more ME patients than controls (roughly 60:40 ratio) for that reason. Tronstadt did not control for current PEM status a the time of sampling in their 2016 paper.
I agree it would be really interesting to see work done that looks at PEM and related things such as longitudinal sampling, response to exertion/exercise, or good day/bad day sampling.
Those last two are possibilities have been haunting my thoughts for a while. Partly because if it was a single something you'd think somebody would have at least narrowed the field down by now, though I take your point that some somethings are harder to find than othersAs for the factor itself, there's various possibilities for what the nature of it might be.
- It could be a single protein/protein complex or some other molecule (which you might expect (prote)omics to have picked up in the past).
- It could be a modified protein eg phosphorylated/cleaved (which proteomics is likely to miss)
- It could be the absence of something that is present in the healthy blood
- It could be multiple proteins/molecules that either work in concert or redundantly, which may also vary between patients but still leading to the same endpoint.
One thing is finding something, another is finding an absence of something, especially when there are a lot of potential somethings in the blood that could be AWOL. How would you do that, technically speaking?