Exploring changes over time and characteristics associated with data retrieval across individual participant data meta-analyses: systematic review

Sarah J Nevitt, Anthony G Marson, Becky Davie, Sally Reynolds, Lisa Williams, Catrin Tudur Smith

Research output: Contribution to journalReview articlepeer-review

Abstract

Objective To investigate whether the success rate of retrieving individual participant data (IPD) for use in IPD meta-analyses has increased over time, and to explore the characteristics associated with IPD retrieval.Design Systematic review of published IPD meta-analyses, supplemented by a reflection of the Cochrane Epilepsy Group's 20 years' experience of requesting IPD.Data sources Medline, CENTRAL, Scopus, Web of Science, CINAHL Plus, and PsycINFO.Eligibility criteria for study selection IPD meta-analyses of studies of all designs and all clinical areas published in English.Results 760 IPD meta-analyses which identified studies by systematic methods that had been published between 1987 and 2015 were included. Only 188 (25%) of these IPD meta-analyses retrieved 100% of the eligible IPD for analysis, with 324 (43%) of these IPD meta-analyses retrieving 80% or more of relevant IPD. There is insufficient evidence to suggest that IPD retrieval rates have improved over time. IPD meta-analyses that included only randomised trials, had an authorship policy, included fewer eligible participants, and were conducted outside of the Cochrane Database of Systematic Reviews were associated with a high or complete IPD retrieval rate. There was no association between the source of funding of the IPD meta-analyses and IPD retrieval rate. The IPD retrieval rate of the Cochrane Epilepsy Group has declined from 83% (up to 2005) to 65% (between 2012 and 2015) and the reported reasons for lack of data availability have changed in recent years.Conclusions IPD meta-analyses are considered to be the "gold standard" for the synthesis of data from clinical research studies; however, only 25% of published IPD meta-analyses have had access to all IPD.

Original languageEnglish
Pages (from-to)j1390
JournalBMJ (Clinical research ed.)
Volume357
DOIs
Publication statusPublished - 5 Apr 2017

Bibliographical note

Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Keywords

  • Humans
  • Information Storage and Retrieval/methods
  • Meta-Analysis as Topic
  • Research Subjects

Cite this