Research output: Contribution to journal › Review article › peer-review
Poor allocation concealment methods are associated with heterogeneity in age and statistical significance of the primary outcome : Review of recent trials published in four general medical journals. / Mitchell, Alex; Moe-Byrne, Thirimon; Cunningham-Burley, Rachel; Dean, Alexandra; Rangan, Aditi; Roche, Jenny; Torgerson, David J.
In: Journal of Evaluation in Clinical Practice, 12.12.2019.Research output: Contribution to journal › Review article › peer-review
}
TY - JOUR
T1 - Poor allocation concealment methods are associated with heterogeneity in age and statistical significance of the primary outcome
T2 - Review of recent trials published in four general medical journals
AU - Mitchell, Alex
AU - Moe-Byrne, Thirimon
AU - Cunningham-Burley, Rachel
AU - Dean, Alexandra
AU - Rangan, Aditi
AU - Roche, Jenny
AU - Torgerson, David J
N1 - © 2019 John Wiley & Sons, Ltd. This is an author-produced version of the published paper. Uploaded in accordance with the publisher’s self-archiving policy. Further copying may not be permitted; contact the publisher for details.
PY - 2019/12/12
Y1 - 2019/12/12
N2 - OBJECTIVE: To assess the association of the quality of allocation concealment with heterogeneity in age, the P value of the primary outcome and statistical significance of the primary outcome.STUDY DESIGN AND SETTING: We extracted data from articles published in four major medical journals in 2017 and 2018 that reported the results of randomized controlled trials. The outcome measures were the quality of allocation concealment used in the trial, the P value of the primary outcome, whether the P value of the primary outcome was statistically significant and the level of heterogeneity in age between the treatment groups (measured using the I2 statistic). The association between the quality of allocation concealment and the P value of the primary outcome was assessed using a kernel density plot, while the association between the quality of allocation concealment and whether the P value was statistically significant was assessed using logistic regression.RESULTS: Trials that used inadequate concealment methods were more likely to report statistically significant findings than trials that used good or adequate methods (OR 1.90; 95% CI: 0.91 to 3.95; P = .09). The values of I2 for trials that used good, adequate, inadequate and unclear concealment methods were 0%, 1.0%, 32.6%, and 93.8%, respectively.CONCLUSION: There is evidence of an association between poor allocation concealment methods and statistical significance of the primary outcome. Trials that use inadequate allocation concealment methods are more likely to have statistically significant P values compared with trials using good or adequate allocation concealment methods.
AB - OBJECTIVE: To assess the association of the quality of allocation concealment with heterogeneity in age, the P value of the primary outcome and statistical significance of the primary outcome.STUDY DESIGN AND SETTING: We extracted data from articles published in four major medical journals in 2017 and 2018 that reported the results of randomized controlled trials. The outcome measures were the quality of allocation concealment used in the trial, the P value of the primary outcome, whether the P value of the primary outcome was statistically significant and the level of heterogeneity in age between the treatment groups (measured using the I2 statistic). The association between the quality of allocation concealment and the P value of the primary outcome was assessed using a kernel density plot, while the association between the quality of allocation concealment and whether the P value was statistically significant was assessed using logistic regression.RESULTS: Trials that used inadequate concealment methods were more likely to report statistically significant findings than trials that used good or adequate methods (OR 1.90; 95% CI: 0.91 to 3.95; P = .09). The values of I2 for trials that used good, adequate, inadequate and unclear concealment methods were 0%, 1.0%, 32.6%, and 93.8%, respectively.CONCLUSION: There is evidence of an association between poor allocation concealment methods and statistical significance of the primary outcome. Trials that use inadequate allocation concealment methods are more likely to have statistically significant P values compared with trials using good or adequate allocation concealment methods.
U2 - 10.1111/jep.13313
DO - 10.1111/jep.13313
M3 - Review article
C2 - 31828920
JO - Journal of Evaluation in Clinical Practice
JF - Journal of Evaluation in Clinical Practice
SN - 1356-1294
ER -