Development of symptom assessments utilising item response theory and computer-adaptive testing--a practical method based on a systematic review

TY - JOUR

T1 - Development of symptom assessments utilising item response theory and computer-adaptive testing--a practical method based on a systematic review

AU - Walker, Jochen

AU - Böhnke, Jan R

AU - Cerny, Thomas

AU - Strasser, Florian

PY - 2010/1

Y1 - 2010/1

N2 - Assessment of individual patients' distress is a cornerstone of clinical care for advanced cancer. Patients' ability to fill out lengthy questionnaires is compromised by many factors. Computer-adaptive tests (CAT) offer a promising approach to developing tailored instruments, that administer only items relevant to the individual patient. A systematic review of the literature about CATs in medical databases was conducted. Based on the results, a method for developing a CAT was designed that requires nine steps: (1) build an item pool; (2) administer the items to a predefined sample in a calibration study; (3) eliminate inappropriate items; (4) examine whether all items are influenced by a single dominant trait; (5) calibrate the items to the best-fitting item response theory (IRT) model; (6) evaluate items' parameter equivalence across subgroups; (7) build an item bank with the calibrated items; (8) develop the CAT; and (9) pilot test the developed CAT. CAT offers the chance to extend the usefulness of patient-reported outcome (PRO) measurements from clinical studies to daily clinical practice.

AB - Assessment of individual patients' distress is a cornerstone of clinical care for advanced cancer. Patients' ability to fill out lengthy questionnaires is compromised by many factors. Computer-adaptive tests (CAT) offer a promising approach to developing tailored instruments, that administer only items relevant to the individual patient. A systematic review of the literature about CATs in medical databases was conducted. Based on the results, a method for developing a CAT was designed that requires nine steps: (1) build an item pool; (2) administer the items to a predefined sample in a calibration study; (3) eliminate inappropriate items; (4) examine whether all items are influenced by a single dominant trait; (5) calibrate the items to the best-fitting item response theory (IRT) model; (6) evaluate items' parameter equivalence across subgroups; (7) build an item bank with the calibrated items; (8) develop the CAT; and (9) pilot test the developed CAT. CAT offers the chance to extend the usefulness of patient-reported outcome (PRO) measurements from clinical studies to daily clinical practice.

KW - Software

KW - Patient Participation

KW - Humans

KW - Diagnosis, Computer-Assisted

KW - Data Interpretation, Statistical

KW - Calibration

KW - Outcome Assessment (Health Care)

U2 - 10.1016/j.critrevonc.2009.03.007

DO - 10.1016/j.critrevonc.2009.03.007

M3 - Article

C2 - 19375939

SN - 1879-0461

VL - 73

SP - 47

EP - 67

JO - Critical reviews in oncology/hematology

JF - Critical reviews in oncology/hematology

IS - 1

ER -