Systematic Situation Coverage versus Random Situation Coverage for Safety Testing in an Autonomous Car Simulation

TY - GEN

T1 - Systematic Situation Coverage versus Random Situation Coverage for Safety Testing in an Autonomous Car Simulation

AU - Proma, Nawshin Mannan

AU - Alexander, Rob

N1 - © 2023 Copyright held by the owner/author(s). This is an author-produced version of the published paper. Uploaded in accordance with the University’s Research Publications and Open Access policy.

PY - 2023/10/20

Y1 - 2023/10/20

N2 - Autonomous vehicles (AV) have the potential to improve road transport, but faults in the autonomous driving software can result in serious accidents. To assess the safety of AV driving software, we need to consider the wide variety and diversity of situations that it may encounter. Explicit situation coverage has previously been presented, but its usefulness has received a little empirical scrutiny. In this study, we evaluate a situation coverage based safety testing approach by comparing the performance of random and situation coverage-based test generation in terms of its ability to detect seeded faults in our ego AV at a road intersection under diverse environmental conditions. Our results suggest that this implementation of situation coverage, at least, does not provide an advantage over random generation.

AB - Autonomous vehicles (AV) have the potential to improve road transport, but faults in the autonomous driving software can result in serious accidents. To assess the safety of AV driving software, we need to consider the wide variety and diversity of situations that it may encounter. Explicit situation coverage has previously been presented, but its usefulness has received a little empirical scrutiny. In this study, we evaluate a situation coverage based safety testing approach by comparing the performance of random and situation coverage-based test generation in terms of its ability to detect seeded faults in our ego AV at a road intersection under diverse environmental conditions. Our results suggest that this implementation of situation coverage, at least, does not provide an advantage over random generation.

U2 - 10.1145/3615366.3625077

DO - 10.1145/3615366.3625077

M3 - Conference contribution

SP - 208

EP - 213

BT - LADC 2023: 12th Latin-American Symposium on Dependable and Secure Computing

PB - ACM

T2 - LADC 2023: 12th Latin-American Symposium on Dependable and Secure Computing

Y2 - 16 October 2023 through 20 October 2023

ER -