rvallee
Senior Member (Voting Rights)
So that all other things are as equal as possible, it's basically A/B testing. If it's not done right it doesn't give you reliable results and it's rarely perfect anyway, you can only reduce uncertainty, never eliminate it. There are always individual biological differences that can't be accounted for. The average values for the average human body only hold for other aggregates, not very well on individuals. That's why size is usually what makes this "effect" disappear, they almost never survive regression to the mean, and the few that do are either too trivial or random to be useful.So why is it that double blinded pharmaceutical trials with objective outcomes, still have to control for placebo effects?
But there has never been any significant and reliable objective changes observed to such an effect. The effects that are hyped are always subjective, about "helping". Observing "a change" in something doesn't necessarily mean anything. Or argued in some way that accomplishes the same, like how cortisol is often used as a proxy for stress, even though cortisol does a crap ton of things. That just falls in all other things not being equal.
The same principle is commonly used in economics, where the problems are the same: you can't ever account for all factors going into why people make some decisions over others. But it's understood to be a limitation, at least by most. That's why economics has moved away from holding their early sacred models of homo economicus, the rational actor who optimizes utility based on perfect information, to understand that they are just that: models.