Preprint The development & psychometric evaluation of Post Activity Symptom Scale (PASS) for Myalgic Encephalomyelitis/CFS,2026,Horton/Tyson/Fleming

Dolphin

Senior Member (Voting Rights)

The development and psychometric evaluation of the Post Activity Symptom Scale (PASS) for Myalgic Encephalomyelitis/ Chronic Fatigue Syndrome​

Mike C Horton, Sarah F Tyson, Russell Fleming
doi: https://doi.org/10.64898/2026.11.06.26367424




ABSTRACT​

Purpose To develop and psychometrically evaluate a new scale measuring post-exertional malaise in people with myalgic encephalomyelitis (ME)/ chronic fatigue syndrome (CFS).

Methods A draft scale was co-produced with patient and clinician advisory groups. After extensive pilot testing, adults with ME/CFS completed the Post Activity Symptom Scale online and repeated it two weeks later to assess test-retest reliability and sensitivity to change. Rasch analysis assessed each domain for unidimensionality, targeting, internal reliability, item fit and local dependency. Then Rasch-transformed interval data and parametric statistics were used to assess criterion-related and discriminant validity (by comparison with measures of physical health and ME/CFS severity), test-retest reliability and minimal detectable difference.

Results The item regarding ‘delay in PEM onset’ was an under-discriminating misfit anomaly which was inconsistent with the remaining PASS items. When this was removed, the PASS was a unidimensional, psychometrically robust scale. Criterion-related validity (r=0.58, p<0.001) was moderate and highly significant, discriminant validity (p<0.001) and test-retest reliability (ICC = 0.81) were excellent. The minimal detectable difference was 1.93/100. Participants found the PASS easy to complete, comprehensive and relevant.

Conclusion The Post Activity Symptom Scale is a valid, reliable, sensitive measure of people of PEM in ME/CFS
 

The development and psychometric evaluation of the Post Activity Symptom Scale (PASS) for Myalgic Encephalomyelitis/ Chronic Fatigue Syndrome​

Mike C Horton, Sarah F Tyson, Russell Fleming
doi: https://doi.org/10.64898/2026.11.06.26367424




ABSTRACT​

Purpose To develop and psychometrically evaluate a new scale measuring post-exertional malaise in people with myalgic encephalomyelitis (ME)/ chronic fatigue syndrome (CFS).

Methods A draft scale was co-produced with patient and clinician advisory groups. After extensive pilot testing, adults with ME/CFS completed the Post Activity Symptom Scale online and repeated it two weeks later to assess test-retest reliability and sensitivity to change. Rasch analysis assessed each domain for unidimensionality, targeting, internal reliability, item fit and local dependency. Then Rasch-transformed interval data and parametric statistics were used to assess criterion-related and discriminant validity (by comparison with measures of physical health and ME/CFS severity), test-retest reliability and minimal detectable difference.

Results The item regarding ‘delay in PEM onset’ was an under-discriminating misfit anomaly which was inconsistent with the remaining PASS items. When this was removed, the PASS was a unidimensional, psychometrically robust scale. Criterion-related validity (r=0.58, p<0.001) was moderate and highly significant, discriminant validity (p<0.001) and test-retest reliability (ICC = 0.81) were excellent. The minimal detectable difference was 1.93/100. Participants found the PASS easy to complete, comprehensive and relevant.

Conclusion The Post Activity Symptom Scale is a valid, reliable, sensitive measure of people of PEM in ME/CFS
No it isnt
 
From the abstract results : “The item regarding ‘delay in PEM onset’ was an under-discriminating misfit anomaly which was inconsistent with the remaining PASS items. When this was removed, the PASS was a unidimensional, psychometrically robust scale.”

Sorry my brain is really struggling now. Does this mean they removed question(s) about delay in PEM onset (a distinctive of ME/CFS) because it was inconvenient? Genuinely asking.
 
I have just looked back over our thread where we discussed the questionnaires.
Here is what I copied from the PASS questionnaire when I did it back in 2024
https://s4me.info/threads/uk-me-ass...fs-specialist-services-2023.33221/post-557081

The Post Activity Symptoms Scale (PASS)
The following questions are about the worsening of symptoms people with ME/CFS get when they exceed their baseline, or ‘energy envelope’. Other terms you may come across are post exertional malaise (PEM), a crash, flare up, payback, setback, or relapse. It is most commonly experienced as an increase in symptoms, but it can also involve the onset of different symptoms to your usual baseline, so we refer to a ‘worsening of symptoms'. Overall, we want to capture how things get worse or are more of a struggle when you overdo it (i.e. trigger PEM). We know this is very variable, so the idea is to take an overall snapshot of how it is affecting you at present, rather than trying to record every aspect, and the whole history. This can help you and other people understand the impact it is having and start discussions about how to manage it.


8. Do you experience a worsening of symptoms when you overdo it?
  • No

  • Yes


9. Triggers Which of the following have triggered a worsening of symptoms (ie PEM) over the last month.
No Yes
I do not know what triggers the worsening of symptoms
Physical activity
Cognitive activity,
Social activity
Emotional activity/stress
Other illnesses e.g. a viral infection
Sensory stimulus (e.g. bright lights, loud environments)
Allergies / intolerances (e.g. foods, smells)
Pain
Sleep problems
Change in the weather/ seasonal changes or temperature extremes
Hormonal changes e.g. menstrual cycle or (peri)menopause
Something else (please state)


9a. Which triggers have been most problematic in the last month, in order of how problematic they are:
1st. most problematic

9b. Which triggers have been most problematic in the last month, in order of how problematic they are:
2nd. most problematic

9c. Which triggers have been most problematic in the last month, in order of how problematic they are:
3rd. most problematic

10. Warning signs: Do you have warning signs, so you know in advance that you are about to overdo it/ trigger PEM?
  • No

  • Yes
10b. If yes, what are the warning signs?

11. Symptoms: Which symptoms have worsened when you have ‘overdone it’ (i.e. triggered PEM) in the last month?
No Yes
I do not experience a worsening of symptoms when I overdo it / PEM
Fatigue
Musculo-skeletal symptoms. (e.g. weakness, stiffness, clumsiness)
Pain
Cognitive symptoms: difficulty with thinking and memory (brain fog)
Sleep disturbance (e.g. difficulty getting to sleep, or staying asleep, sleeping during the day)
Neurological symptoms (e.g. headaches, migraine, sensitivities to sound, light etc, altered sensation, tinnitus)
Gastrointestinal symptoms (e.g. nausea, stomach pain, bloating)
Cardio-respiratory symptoms (e.g. palpitations, breathlessness, chest pain, circulation changes)
Orthostatic intolerance (changes in heart rate, breathlessness etc) when becoming more upright (i.e. when sitting or standing up) for a period of time
Dizziness
Loss of temperature control (feeling hot or cold which is not related to the environment)
Allergy symptoms (e.g. sore throat, tender glands/lymph nodes, runny eyes, skin changes, wheezing, flu-like symptoms)
Emotional symptoms (e.g. increased irritability, anxiety or low mood)
Something else (please state)


11a. Please list which symptoms have most troublesome when you have overdone it (ie triggered PEM) in the last month, in order of how problematic they are:
1st. most troublesome

11b. Please list which symptoms have most troublesome when you have overdone it (ie triggered PEM) in the last month, in order of how problematic they are:
2nd. most troublesome

11c. Please list which symptoms have most troublesome when you have overdone it (ie triggered PEM) in the last month, in order of how problematic they are:
3rd. most troublesome

11d. Is there anything else you would like to tell us about the symptoms you experience when you have overdone it/ triggered PEM?

12. Level of activity triggering a worsening of symptoms / PEM
NB. This question refers to what is strenuous, demanding or stressful activity for you at present. Essentially, we are asking for a ballpark figure about how much you can do without triggering a worsening of symptoms. This indicates the size of your ‘energy envelope’, which is an important issue when it comes to managing energy and activity levels, and pacing. We are not asking about a comparison with other people with ME/CFS, healthy people, or how you were before you became ill. We understand that the baseline levels of symptoms fluctuate, which will impact on how much you can do.


12. Overall, in the last month what level of activity has typically triggered a worsening of symptoms when you overdo it?
  • I do not experience a worsening of symptoms /PEM

  • Strenuous or stressful activity (for you)

  • Moderately demanding or stressful activity (for you)

  • Mildly demanding or stressful activity (for you)


13. Frequency: Over the last month, how often have you overdone it and triggered a worsening of symptoms/ post exertional malaise?
  • I do not experience a worsening of symptoms /PEM

  • Constantly

  • Daily

  • Weekly

  • Occasionally (less than weekly)


14. Delay: In the last month, has the worsening symptoms (i.e. onset of PEM) typically been delayed after you have overdone it?
  • I do not experience a worsening of symptoms /PEM

  • Yes, delay of less than an hour

  • Yes, delay of an hour or more

  • Yes, delay of a day or more

  • The changes involve both rapid onset and later onset changes


15. Duration of the change in symptoms: In the last month, how long does the worsening of symptoms typically last/ take to recover after you have overdone it / triggered PEM?
  • I do not experience a worsening of symptoms /PEM

  • A day or less

  • Several days

  • About a week

  • More than a week


16. Impact on daily life: In the last month, what impact has worsening symptoms when you overdo it / post-exertional malaise typically had on your day-to-day life?
  • I do not experience a worsening of symptoms /PEM

  • Significant issue

  • Major issue

  • Very major issue


17. Is there anything else you would like us to know about your symptom worsening when you overdo it/ post exertional malaise?

18. Is there anything else about the questionnaire you would like to tell us?

I gather from the preprint that this has somehow been turned into a numerical scale which is supposedly enabling the calculation of a single figure that is a 'measure' of PEM and can be used by clinics of the BACME variety to assess whether someones PEM has improved while attending the clinic.

It's diabolically bad. All that statistical flummery doesn't and can't overcome the GIGO problem with this data.
 
Sorry my brain is really struggling now. Does this mean they removed question(s) about delay in PEM onset (a distinctive of ME/CFS) because it was inconvenient? Genuinely asking.
I think it probably means they discovered that a figure calculated for delay bears no relation to the figures calculated for the other dimensions, so it's best left out of the overall calculation. It will probably still be in the questionnaire. The whole think is a farce.
 
We resolved to avoid using the term ‘post-exertional malaise’ in the title and the body of the scale. This was because some people find the terms ‘exertion’ and ‘malaise’ problematic as they cannot exert themselves, and malaise was considered redolent of malingering.Furthermore, feedback from the clinicians was that patients often did not understand the terms and they were difficult to explain. So, we referred to a ‘worsening of symptoms when you overdo it’. The timescale for questions was “over the last month, in keeping with the rest of the MEA-CAT.

Dumbing down, treating pwME like children. If clinicians can't explain what PEM is to patients, perhaps that suggests the clinicians don't know what it is. Clearly the designers of this questionnaire aren't too clear, as they muddle it up with fatigability, exercise intolerance, DOMS and PEF. They should read our fact sheet.
 
Everything they’re working on follows the same pattern of taking questionnaires and running them through a bunch of impressive sounding statistical processes to ‘prove’ they are worthwhile. Take subjective things and claim they’re objective and overstate the robustness of everything, publish. Agree with @Trish there also looks to be straight errors in there.

I was really into maths, but always a bit snobby about statistics, which I have come to understand was a mistake on my part, statistics can be as beautiful as pure maths. But not when done like this.

That said stats was never my thing and certainly isn’t something I’m confident in. Would love to get a healthy expert statistician to dissect the methodology in all these papers they’re coming out with. There could be a good rebuttal of the whole mess here but it’s probably a lot of time involved. The money the MEA has thrown at this partnership is getting publishing credits but it’s quantity over quality IMHO.
 
My stats knowledge is way out of date, but there are simple principles that seem to be flouted here. The worst, of course, is that the data you analyse has to be measuring something meaningful, and decisions to turn descriptive data such as what triggers PEM, and numbers of symptoms, into numerical data has to make clinical sense. Which it doesn't. No amount of fancy stats can overcome problems like asking unanswerable questions, like how strenuous or stressful the level of activity that triggers symptoms is in question 12, without any benchmarks.
 
"Our primary aim was to co-produce a psychometrically robust tool to support clinical assessment. The work was part of larger project to develop and evaluate a clinical assessment toolkit"

That just says this is an assessment to use i assessment.
The question is what for!!
IIRC Tyson was very verbose in explaining the minutiae of how this is robust and gold standard or whatever, from an “assessing how the stats are collected and crunched” point of view. Which neatly sidestepped the “but what the hell are you defining PEM as, and its effects” question.
 
Back
Top Bottom