Shortening self-report mental health symptom measures through optimal test assembly methods: Development and validation of the Patient Health Questionnaire-Depression-4

Miyabi Ishihara, Daphna Harel*, Brooke Levis, Alexander W. Levis, Kira E. Riehm, Nazanin Saadat, Marleine Azar, Danielle B. Rice, Tatiana A. Sanchez, Matthew J. Chiovitti, Pim Cuijpers, Simon Gilbody, John P.A. Ioannidis, Lorie A. Kloda, Dean McMillan, Scott B. Patten, Ian Shrier, Bruce Arroll, Charles H. Bombardier, Peter ButterworthGregory Carter, Kerrie Clover, Yeates Conwell, Felicity Goodyear-Smith, Catherine G. Greeno, John Hambridge, Patricia A. Harrison, Marie Hudson, Nathalie Jetté, Kim M. Kiely, Anthony McGuire, Brian W. Pence, Alasdair G. Rooney, Abbey Sidebottom, Adam Simning, Alyna Turner, Jennifer White, Mary A. Whooley, Kirsty Winkley, Andrea Benedetti, Brett D. Thombs

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Background: The objective of this study was to develop and validate a short form of the Patient Health Questionnaire-9 (PHQ-9), a self-report questionnaire for assessing depressive symptomatology, using objective criteria. Methods: Responses on the PHQ-9 were obtained from 7,850 English-speaking participants enrolled in 20 primary diagnostic test accuracy studies. PHQ unidimensionality was verified using confirmatory factor analysis, and an item response theory model was fit. Optimal test assembly (OTA) methods identified a maximally precise short form for each possible length between one and eight items, including and excluding the ninth item. The final short form was selected based on prespecified validity, reliability, and diagnostic accuracy criteria. Results: A four-item short form of the PHQ (PHQ-Dep-4) was selected. The PHQ-Dep-4 had a Cronbach's alpha of 0.805. Sensitivity and specificity of the PHQ-Dep-4 were 0.788 and 0.837, respectively, and were statistically equivalent to the PHQ-9 (sensitivity = 0.761, specificity = 0.866). The correlation of total scores with the full PHQ-9 was high (r = 0.919). Conclusion: The PHQ-Dep-4 is a valid short form with minimal loss of information of scores when compared to the full-length PHQ-9. Although OTA methods have been used to shorten patient-reported outcome measures based on objective, prespecified criteria, further studies are required to validate this general procedure for broader use in health research. Furthermore, due to unexamined heterogeneity, there is a need to replicate the results of this study in different patient populations.

Original languageEnglish
Pages (from-to)82-92
Number of pages11
JournalDepression and anxiety
Volume36
Issue number1
Early online date20 Sept 2018
DOIs
Publication statusPublished - Jan 2019

Bibliographical note

Funding Information:
Safe Work Australia; Lady Davis Institute of Medical Research of the Jewish General Hospital; Inova Diagnostics Inc; Canadian Arthritis Network; Euroimmun; Alberta Health Services, the University of Calgary Faculty of Medicine, and the Hotchkiss Brain Institute; United States Department of Health and Human Services, Health Resources and Services Administration; Health Research Council of New Zealand; National Center for Research Resources; Australian National Health and Medical Research Council fellowship; United Kingdom National Health Service Lothian Neuro-Oncology Endowment Fund; National Institute of Mental Health, Grant/Award Numbers: K02 MH65919, P30 DK50456, R24 MH071604, R24 MH56858, R24MH071604, R34 MH072925, R34MH084673

Funding Information:
This study was funded by the Canadian Institutes of Health Research (CIHR; KRS-134297). Dr. Harel was supported by NYU start-up research grants. Ms. Levis was supported by a CIHR Frederick Banting and Charles Best Canada Graduate Scholarship doctoral award. Mr. Levis and Ms. Azar were supported by Fonds de recherche du Québec—Santé (FRQS) Masters Training Awards. Ms. Riehm and Ms. Saadat were supported by CIHR Frederick Banting and Charles Best Canadian Graduate Scholarships—Master's Awards. Ms. Rice was supported by a Vanier Canada Graduate Scholarship. The primary studies by Amoozegar and Fiest et al. were funded by the Alberta Health Services, University of Calgary Faculty of Medicine, and Hotchkiss Brain Institute. Collection of data for the study by Arroll et al. was supported by a project grant from the Health Research Council of New Zealand. Data for the study by Razykov et al. were collected by the Canadian Scleroderma Research Group, which was funded by the CIHR (FRN 83518), the Scleroderma Society of Canada, the Scleroderma Society of Ontario, the Scleroderma Society of Saskatchewan, Sclérodermie Québec, the Cure Scleroderma Foundation, Inova Diagnostics, Inc., Euroimmun, FRQS, the Canadian Arthritis Network, and the Lady Davis Institute of Medical Research of the Jewish General Hospital, Montreal, QC. The primary study by Bombardier et al. was supported by the Department of Education, National Institute on Disability and Rehabilitation Research, Spinal Cord Injury Model Systems: University of Washington (grant no. H133N060033), Bay-lor College of Medicine (grant no. H133N060003), and University of Michigan (grant no. H133N060032). Collection of data for the primary study by Kiely et al. was supported by National Health and Medical Research Council (grant no. 1002160) and Safe Work Australia. Dr. Butterworth was supported by Australian Research Council Future Fellowship FT130101444. Dr. Conwell received support from NIMH (R24MH071604) and the Centers for Disease Control and Prevention (R49 CE002093). Collection of data for the primary study by Gjerdingen et al. was supported by grants from the NIMH (R34 MH072925, K02 MH65919, P30 DK50456). The primary study by Eack et al. was funded by the NIMH (R24 MH56858). Collection of data for the studies by Turner et al. was funded by a bequest from Jennie Thomas through the Hunter Medical Research Institute. The primary study by Sidebottom et al. was funded by a grant from the U.S. Department of Health and Human Services, Health Resources and Services Administration (grant no. R40MC07840). Dr. Hudson was supported by an FRQS Senior Investigator Award. The primary study by Twist et al. was funded by the U.K. National Institute for Health Research under its Programme Grants for Applied Research Programme (grant reference no. RP-PG-0606-1142). Dr. Jetté was supported by a Canada Research Chair in Neurological Health Services Research. Dr. Kiely was supported by funding from Australian National Health and Medical Research Council fellowship (grant no. 1088313). Collection of data for the primary study by Williams et al. was supported by an NIMH grant to Dr. Marsh (RO1-MH069666). Collection of primary data for the study by Dr. Pence was provided by NIMH (R34MH084673). The primary study by Rooney et al. was funded by the U.K. National Health Service Lothian Neuro-Oncology Endowment Fund. Simning et al.’s research was supported in part by grants from the NIH (T32 GM07356), Agency for Healthcare Research and Quality (R36 HS018246), NIMH (R24 MH071604), and the National Center for Research Resources (TL1 RR024135). The primary study by Thombs et al. was done with data from the Heart and Soul Study (PI Mary Whooley). The Heart and Soul Study was funded by the Department of Veterans Epidemiology Merit Review Program, the Department of Veterans Affairs Health Services Research and Development service, the National Heart Lung and Blood Institute (R01 HL079235), the American Federation for Aging Research, the Robert Wood Johnson Foundation, and the Ischemia Research and Education Foundation. Drs. Benedetti and Thombs were supported by FRQS researcher salary awards. No other authors reported funding for primary studies or for their work on the present study.

Funding Information:
Drs. Jetté and Patten declare that they received a grant, outside the submitted work, from the Hotchkiss Brain Institute, which was jointly funded by the Institute and Pfizer. Pfizer was the original sponsor of the development of the PHQ-9, which is now in the public domain. All other authors declare no competing interests. No funder had any role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.

Publisher Copyright:
© 2018 Wiley Periodicals, Inc.

Keywords

  • depression
  • Patient Health Questionnaire
  • patient outcome assessment
  • psychometrics

Cite this