The strong focus on positive results in abstracts may cause bias in systematic reviews: a case study on abstract reporting bias, 2019, Duyx et al

Andy · Oct 4, 2019

Background
Research articles tend to focus on positive findings in their abstract, especially if multiple outcomes have been studied. At the same time, search queries in databases are generally limited to the abstract, title and keywords fields of an article. Negative findings are therefore less likely to be detected by systematic searches and to appear in systematic reviews. We aim to assess the occurrence of this ‘abstract reporting bias’ and quantify its impact in the literature on the association between diesel exhaust exposure (DEE) and bladder cancer.

Methods
We set up a broad search query related to DEE and cancer in general. Full-texts of the articles identified in the search output were manually scanned. Articles were included if they reported, anywhere in the full-text, the association between DEE and bladder cancer. We assume that the use of a broad search query and manual full-text scanning allowed us to catch all the relevant articles, including those in which bladder cancer was not mentioned in the abstract, title or keywords.

Results
We identified 28 articles. Only 12 of these (43%) had mentioned bladder in their abstract, title or keywords. A meta-analysis based on these 12 detectable articles yielded a pooled risk estimate of 1.10 (95% confidence interval [CI] 0.97–1.25), whereas the meta-analysis based on all 28 articles yielded a pooled estimate of 1.03 (95% CI 0.96–1.11).

Conclusions
This case study on abstract reporting bias shows that (a) more than half of all relevant articles were missed by a conventional search query and (b) this led to an overestimation of the pooled effect. Detection of articles will be improved if all studied exposure and outcome variables are reported in the keywords. The restriction on the maximum number of keywords should be lifted.
Click to expand...

Open access, https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6637611/

Snow Leopard · Oct 4, 2019

What about positive bias in abstracts of systematic reviews?

shak8 · Oct 4, 2019

So true. Abstracts tend to be misleading.

Sly Saint · Aug 30, 2020

I've been thinking about this recently and came to the conclusion that any 'limitations' (usually included in the main text) should also be in the abstract.

(Sometimes they appear under 'strengths and weaknesses').

surprised that journals/orgs who claim to be all about 'evidence-based' science haven't thought of it.

Log in or Sign up

The strong focus on positive results in abstracts may cause bias in systematic reviews: a case study on abstract reporting bias, 2019, Duyx et al

Andy Committee Member

Snow Leopard Senior Member (Voting Rights)

shak8 Senior Member (Voting Rights)

Sly Saint Senior Member (Voting Rights)

Share This Page

Log in or Sign up

The strong focus on positive results in abstracts may cause bias in systematic reviews: a case study on abstract reporting bias, 2019, Duyx et al

Andy Committee Member

Snow Leopard Senior Member (Voting Rights)

shak8 Senior Member (Voting Rights)

Sly Saint Senior Member (Voting Rights)

Share This Page

Useful Searches