Ethics in conversation: Building an ethics assurance case for autonomous AI-enabled voice agents in healthcare

Marten Henry Leon Kaas*, Zoe Porter, Ernest Lim, Aisling Higham, Sarah Khavandi, Ibrahim Habli

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The deployment and use of AI systems should be both safe and broadly ethically acceptable. The principles-based ethics assurance argument pattern is one proposal in the AI ethics landscape that seeks to support and achieve that aim. The purpose of this argument pattern or framework is to structure reasoning about, and to communicate and foster confidence in, the ethical acceptability of uses of specific real-world AI systems in complex socio-technical contexts. This paper presents the interim findings of a case study applying this ethics assurance framework to the use of Dora, an AI-based telemedicine system, to assess its viability and usefulness as an approach. The case study process to date has revealed some of the positive ethical impacts of the Dora platform, as well as unexpected insights and areas to prioritise for evaluation, such as risks to the frontline clinician, particularly in respect of clinician autonomy. The ethics assurance argument pattern offers a practical framework not just for identifying issues to be addressed, but also to start to construct solutions in the form of adjustments to the distribution of benefits, risks and constraints on human autonomy that could reduce ethical disparities across affected stakeholders. Though many challenges remain, this research represents a step in the direction towards the development and use of safe and ethically acceptable AI systems and, ideally, a shift towards more comprehensive and inclusive evaluations of AI systems in general.
Original languageEnglish
Title of host publicationTAS '23: Proceedings of the First International Symposium on Trustworthy Autonomous Systems
PublisherACM
ISBN (Print)979-8-4007-0734-6
DOIs
Publication statusPublished - 11 Jul 2023
EventTAS '23: First International Symposium on Trustworthy Autonomous Systems - Edinburgh, United Kingdom
Duration: 11 Jul 202312 Jul 2023

Conference

ConferenceTAS '23: First International Symposium on Trustworthy Autonomous Systems
Country/TerritoryUnited Kingdom
CityEdinburgh
Period11/07/2312/07/23

Bibliographical note

© 2023 Copyright held by the owner/author(s).

Keywords

  • ethics assurance
  • case study
  • AI-based telemedicine
  • Dora platform
  • medical device
  • ethical acceptability

Cite this