Risk-aware Real-time Object Detection

TY - GEN

T1 - Risk-aware Real-time Object Detection

AU - Alpizar Santana, Misael

AU - Calinescu, Radu

AU - Paterson, Colin

N1 - This is an author-produced version of the published paper. Uploaded in accordance with the publisher’s self-archiving policy. Further copying may not be permitted; contact the publisher for details

PY - 2022/11/2

Y1 - 2022/11/2

N2 - Autonomous systems such as self-driving cars and infrastructure inspection robots must be able to mitigate risk by dependably detecting entities that represent factors of risk in their environment (e.g., humans and obstacles). Nevertheless, current machine learning (ML) techniques for real-time object detection disregard risk factors in their training and verification. As such, they produce ML models that place equal emphasis on the correct detection of all classes of objects of interest—including, for instance, buses and cats in a self-driving scenario. To address this limitation of existing solutions, this short paper introduces a work-in-progress method for the development of risk-aware ML ensembles for real-time object detection. Our new method supports the dependable use of real-time object detection in autonomous systems by (i) identifying the risks that require treatment, (ii) training a set of ML models that mitigate these risks, and (iii) using multi-objective genetic algorithms to combine the ML models into risk-aware ML ensembles. We present preliminary experiments that show the effectiveness of our method at constructing a dependable ML ensemble for real-time object detection in a simulated self-driving case study.

AB - Autonomous systems such as self-driving cars and infrastructure inspection robots must be able to mitigate risk by dependably detecting entities that represent factors of risk in their environment (e.g., humans and obstacles). Nevertheless, current machine learning (ML) techniques for real-time object detection disregard risk factors in their training and verification. As such, they produce ML models that place equal emphasis on the correct detection of all classes of objects of interest—including, for instance, buses and cats in a self-driving scenario. To address this limitation of existing solutions, this short paper introduces a work-in-progress method for the development of risk-aware ML ensembles for real-time object detection. Our new method supports the dependable use of real-time object detection in autonomous systems by (i) identifying the risks that require treatment, (ii) training a set of ML models that mitigate these risks, and (iii) using multi-objective genetic algorithms to combine the ML models into risk-aware ML ensembles. We present preliminary experiments that show the effectiveness of our method at constructing a dependable ML ensemble for real-time object detection in a simulated self-driving case study.

U2 - 10.1109/EDCC57035.2022.00026

DO - 10.1109/EDCC57035.2022.00026

M3 - Conference contribution

BT - 18th European Dependable Computing Conference

PB - IEEE

ER -