By the same authors

From the same journal

Problems caused by heterogeneity in meta-analysis: a case study of acupuncture trials

Research output: Contribution to journalArticle

Published copy (DOI)

Author(s)

Department/unit(s)

Publication details

JournalAcupuncture in Medicine
DateE-pub ahead of print - 18 Oct 2013
DatePublished (current) - Feb 2014
Issue number1
Volume32
Number of pages6
Pages (from-to)56-61
Early online date18/10/13
Original languageEnglish

Abstract

OBJECTIVES:

To illustrate the pitfalls of using meta-analysis to combine estimates of effect in trials that are highly varied and have a high potential for bias.

METHODS:

We used a random-effects meta-analysis to pool the results of 51 sham-controlled acupuncture trials of chronic pain published in English before 2008 and explored the heterogeneity using meta-regression. We repeated the process on a subset of these trials that used a visually credible non-penetrating sham device as control (N = 12).

RESULTS:

In both analyses there were high levels of heterogeneity and many studies were at risk from potential bias. The heterogeneity was not explained by meta-regression.

CONCLUSIONS:

Trials of interventions that have high potential for bias, such as many in the acupuncture literature, do not meet the assumptions of the statistical procedure that underlie random-effects meta-analysis. Even in the absence of bias, heterogeneity in meta-analyses is not accounted for by the CIs around the pooled estimate.

Discover related content

Find related publications, people, projects, datasets and more using interactive charts.

View graph of relations