Thank you all for the feedback. I totally see your points, and in many ways some of the questions are there because of the points you raise, not because I expect them to be fully representative, or to give simple results without wider interpretation. The 'locus of control' questions seem to have been picked up on in particular, and I agree they are potentially problematic scales, particularly in the context of chronic illness, or the excellent example about being a carer above, etc. Again, this links with previous research into CAM use and they are there from this perspective. It's a tricky balancing act of answering a research hypothesis in a very complex multifaceted area whilst not wanting to create the world's longest questionnairre (especially given the limitations of those being asked to fill it in). There are many potential limitations with this (and any) study, and they will be kept in mind throughout.
I go through exactly the same cynical thought processes when I'm filling in someone else's survey, and am no less cynical of my own
thanks for your response, Good to know you're keeping the limitations in mind.
I hear you about having to make tough decisions about the number of questions to include, that must be a significant challenge.
But, i'm risking labouring this particular point because i think its critical - Internal vs external locus of control is so important to our wellbeing IMHO, so I can see how that could be relevant to someone's choice to use CAM. And how exploring it could shine interesting light on people's motivations for doing so.
So i wonder... How can a question that
combines perceptions of locus of control in the work and private spheres,
possibly be capable of giving an accurate answer on whether someone's LOC is external or internal?
There are very few people who are self employed (& therefore able to determine their own decisions in the work domain). There are even fewer who are employed by someone else & yet are still able to determine for themselves what they do at work. Indeed lack of obligation to do what someone else dictates, is part of the legal definition of being self employed for tax purposes in the UK!
Therefore, since the majority of people are employed rather than self employed, and the vast majority of
them have little to no say in what they do while they are at work, then the majority of responders' answers must, necessarily, indicate an external locus of control.
An external locus that is normal & standard for an employed status. It cannot be changed except by becoming self employed instead.
So by dint of the question combining both work
and private life, you are heavily & inaccurately biasing the response towards the idea that responders have an external locus of control. Therefore no accurate conclusions can possibly be drawn, since it would be that way for
everyone who is employed by someone else. Whether they use CAM or not. So the results will wrongly imply that their LOC is further towards external than it actually is.
Thats not 'cynicism', its just about accuracy.
So regarding there being a limit on number of questions... what is the point in even including a question that is predictably going to give inaccurate results?
The answer to whether a person feels what they do at work is determined by someone else is going to be 'of course', in the vast majority of cases, regardless of whether they generally feel an external LOC in their lives generally.
It is almost impossible for someone who is employed by someone else to have any significant personal locus of control while at work. So why even include it?
For future study design surely it would be better to consider having the question be about responders' private lives... since that is the only area that people have any significant choice over where their locus of control is coming from. That way you will actually find out whether their general sense of LOC leans more towards external & internal.
You will also be able to avoid the result being polluted by the confusion between those who are actually able to work and those who dont. And by those who have jobs which have more vs less micromanagement and/or zero hours contracts etc.
It might also be an idea, to enable some mitigation for this particular limitation... to tally up the data for the LOC questions using all 3 of the questions in that section, and also using just the 2 questions, without the problematic one. I suspect the 2 results may lead to different conclusions. I'd have thought that the 'im my own boss' & 'fate' questions would be sufficient on their own, without the confounding/biased question.
I do think it'd be interesting to have insight into whether people who have a more external LOC use more CAM, which is why i'm spending my very limited energy writing this.
It's an attempt to be helpful... i hope my tone isnt being heard as critical or negative, i'm quite intrigued by my own use of CAM & why it has fluctuated so much over the yrs, it doesnt seem to be simply related to resources/how ill i was/scientific education gained from places like this forum etc. Its made me think about it all a lot & i look forward to the results of the study... but I hope you'll consider what i've said in more than a cursory way.