Multidimensional performance assessment using dominance criteria

Nils Gutacker; Andrew David Street

Multidimensional performance assessment using dominance criteria

Centre for Health Economics

Research output: Working paper › Discussion paper

Abstract

Public sector organisations pursue multiple objectives and serve a number of stakeholders. But stakeholders are rarely explicit about the valuations they attach to different objectives, nor are these valuations likely to be identical. This complicates the assessment of their performance because no single set of
weights can be legitimately chosen by regulators to aggregate outputs into unidimensional composite scores. We propose the use of dominance criteria in a multidimensional performance assessment framework to identify best practice and poor performance under relatively weak assumptions about stakeholders’
preferences. We estimate multivariate multilevel models to study providers of hip replacement surgery in the English NHS with respect to their performance in terms of length of stay, readmission rates, post-operative patient-reported health status and waiting time. We find substantial correlation between objectives and demonstrate that ignoring the correlation can lead to incorrect assessments of performance.

Original language	English
Place of Publication	York, UK
Publisher	Centre for Health Economics, University of York
Pages	1-34
Number of pages	34
Publication status	Published - Sep 2015

Publication series

Name	CHE Research Paper
Publisher	Centre for Health Economics, University of York
No.	115

Keywords

: Performance assessment, provider classification, multidimensional, multilevel modelling

Access to Document

CHERP115_Multidimensional_performance_assessment_dominance_criteriaFinal published version, 1.5 MB

http://www.york.ac.uk/media/che/documents/papers/researchpapers/CHERP115_Multidimensional_performance_assessment_dominance_criteria.pdf

Cite this

@techreport{5c954337849d4f9ebc3863317bb4c7bc,

title = "Multidimensional performance assessment using dominance criteria",

abstract = "Public sector organisations pursue multiple objectives and serve a number of stakeholders. But stakeholders are rarely explicit about the valuations they attach to different objectives, nor are these valuations likely to be identical. This complicates the assessment of their performance because no single set ofweights can be legitimately chosen by regulators to aggregate outputs into unidimensional composite scores. We propose the use of dominance criteria in a multidimensional performance assessment framework to identify best practice and poor performance under relatively weak assumptions about stakeholders{\textquoteright}preferences. We estimate multivariate multilevel models to study providers of hip replacement surgery in the English NHS with respect to their performance in terms of length of stay, readmission rates, post-operative patient-reported health status and waiting time. We find substantial correlation between objectives and demonstrate that ignoring the correlation can lead to incorrect assessments of performance.",

keywords = ": Performance assessment, provider classification, multidimensional, multilevel modelling",

author = "Nils Gutacker and Street, {Andrew David}",

year = "2015",

month = sep,

language = "English",

series = "CHE Research Paper",

publisher = "Centre for Health Economics, University of York",

number = "115",

pages = "1--34",

type = "WorkingPaper",

institution = "Centre for Health Economics, University of York",

}

TY - UNPB

T1 - Multidimensional performance assessment using dominance criteria

AU - Gutacker, Nils

AU - Street, Andrew David

PY - 2015/9

Y1 - 2015/9

N2 - Public sector organisations pursue multiple objectives and serve a number of stakeholders. But stakeholders are rarely explicit about the valuations they attach to different objectives, nor are these valuations likely to be identical. This complicates the assessment of their performance because no single set ofweights can be legitimately chosen by regulators to aggregate outputs into unidimensional composite scores. We propose the use of dominance criteria in a multidimensional performance assessment framework to identify best practice and poor performance under relatively weak assumptions about stakeholders’preferences. We estimate multivariate multilevel models to study providers of hip replacement surgery in the English NHS with respect to their performance in terms of length of stay, readmission rates, post-operative patient-reported health status and waiting time. We find substantial correlation between objectives and demonstrate that ignoring the correlation can lead to incorrect assessments of performance.

AB - Public sector organisations pursue multiple objectives and serve a number of stakeholders. But stakeholders are rarely explicit about the valuations they attach to different objectives, nor are these valuations likely to be identical. This complicates the assessment of their performance because no single set ofweights can be legitimately chosen by regulators to aggregate outputs into unidimensional composite scores. We propose the use of dominance criteria in a multidimensional performance assessment framework to identify best practice and poor performance under relatively weak assumptions about stakeholders’preferences. We estimate multivariate multilevel models to study providers of hip replacement surgery in the English NHS with respect to their performance in terms of length of stay, readmission rates, post-operative patient-reported health status and waiting time. We find substantial correlation between objectives and demonstrate that ignoring the correlation can lead to incorrect assessments of performance.

KW - : Performance assessment, provider classification, multidimensional, multilevel modelling

M3 - Discussion paper

T3 - CHE Research Paper

SP - 1

EP - 34

BT - Multidimensional performance assessment using dominance criteria

PB - Centre for Health Economics, University of York

CY - York, UK

ER -