Royal Society statistical bias paper

Amw66 · Sep 16, 2018

Paper on statistical bias - a bit beyond me, but maybe of interest to others

http://rsos.royalsocietypublishing.org/content/5/9/181190

Trish · Sep 16, 2018

Estimating statistical power, posterior probability and publication bias of psychological research using the observed replication rate

Michael Ingre, Gustav Nilsonne
Published 12 September 2018

Abstract

In this paper, we show how Bayes' theorem can be used to better understand the implications of the 36% reproducibility rate of published psychological findings reported by the Open Science Collaboration.

We demonstrate a method to assess publication bias and show that the observed reproducibility rate was not consistent with an unbiased literature.
We estimate a plausible range for the prior probability of this body of research, suggesting expected statistical power in the original studies of 48–75%, producing (positive) findings that were expected to be true 41–62% of the time.

Publication bias was large, assuming a literature with 90% positive findings, indicating that negative evidence was expected to have been observed 55–98 times before one negative result was published. These findings imply that even when studied associations are truly NULL, we expect the literature to be dominated by statistically significant findings.
Click to expand...

alktipping · Sep 17, 2018

I find it surprising that they have a 36% reproducibility rate unless it is the same cliques rehashing older papers .

Log in or Sign up

Royal Society statistical bias paper

Amw66 Senior Member (Voting Rights)

Trish Moderator Staff Member

alktipping Senior Member (Voting Rights)

Share This Page

Log in or Sign up

Royal Society statistical bias paper

Amw66 Senior Member (Voting Rights)

Trish Moderator Staff Member

alktipping Senior Member (Voting Rights)

Share This Page

Useful Searches