Evaluating unintended consequences: New insights into solving practical, ethical and political challenges of evaluation

TY - JOUR

T1 - Evaluating unintended consequences: New insights into solving practical, ethical and political challenges of evaluation

AU - Oliver, Kathryn

AU - Lorenc, Theodore Eliot

AU - Tinkler, Jane

N1 - © The Author(s) 2019. This is an author-produced version of the published paper. Uploaded in accordance with the publisher’s self-archiving policy. Further copying may not be permitted; contact the publisher for details.

PY - 2019/6/10

Y1 - 2019/6/10

N2 - Evaluating complex interventions and policies is challenging. This is particularly true for the identification of unintended consequences, whether negative or positive. This article uses data from a workshop with policymakers and evaluators to explore the evaluation of unintended consequences. We identify three main challenges for policymakers and evaluators: being able to identify and evaluate unintended effects, to avoid creating unintended effects and being able to explain these effects. We discuss practical, political and ethical issues for each of these challenges and identify recommendations for evaluators who want to consider unintended consequences. First, use a broader range of methods to explore how policies play out; second, use theory to plan evaluations; and third, discuss both methods and theory with relevant stakeholders to make these as useful as possible. We offer novel insights into recent debates about theory-led and co-produced interventions and policies.

AB - Evaluating complex interventions and policies is challenging. This is particularly true for the identification of unintended consequences, whether negative or positive. This article uses data from a workshop with policymakers and evaluators to explore the evaluation of unintended consequences. We identify three main challenges for policymakers and evaluators: being able to identify and evaluate unintended effects, to avoid creating unintended effects and being able to explain these effects. We discuss practical, political and ethical issues for each of these challenges and identify recommendations for evaluators who want to consider unintended consequences. First, use a broader range of methods to explore how policies play out; second, use theory to plan evaluations; and third, discuss both methods and theory with relevant stakeholders to make these as useful as possible. We offer novel insights into recent debates about theory-led and co-produced interventions and policies.

U2 - 10.1177/1356389019850847

DO - 10.1177/1356389019850847

M3 - Article

SN - 1461-7153

SP - 1

EP - 15

JO - Evaluation.

JF - Evaluation.

ER -