Semantic Data Augmentation for Deep Learning Testing using Generative AI

TY - GEN

T1 - Semantic Data Augmentation for Deep Learning Testing using Generative AI

AU - Missaoui, Sondess

AU - Gerasimou, Simos

N1 - This is an author-produced version of the published paper. Uploaded in accordance with the University’s Research Publications and Open Access policy.

PY - 2023/9/15

Y1 - 2023/9/15

N2 - he performance of state-of-the-art Deep Learning models heavily depends on the availability of well-curated training and testing datasets that sufficiently capture the operational domain. Data augmentation is an effective technique in alleviating data scarcity, reducing the time-consuming and expensive data collection and labelling processes. Despite their potential, existing data augmentation techniques primarily focus on simple geometric and colour space transformations, like noise, flipping and resizing, producing datasets with limited diversity. When the augmented dataset is used for testing the Deep Learning models, the derived results are typically uninformative about the robustness of the models. We address this gap by introducing GENFUZZER, a novel coverage-guided data augmentation fuzzing technique for Deep Learning models underpinned by generative AI. We demonstrate our approach using widely-adopted datasets and models employed for image classification, illustrating its effectiveness in generating informative datasets leading up to a 26% increase in widely-used coverage criteria.

AB - he performance of state-of-the-art Deep Learning models heavily depends on the availability of well-curated training and testing datasets that sufficiently capture the operational domain. Data augmentation is an effective technique in alleviating data scarcity, reducing the time-consuming and expensive data collection and labelling processes. Despite their potential, existing data augmentation techniques primarily focus on simple geometric and colour space transformations, like noise, flipping and resizing, producing datasets with limited diversity. When the augmented dataset is used for testing the Deep Learning models, the derived results are typically uninformative about the robustness of the models. We address this gap by introducing GENFUZZER, a novel coverage-guided data augmentation fuzzing technique for Deep Learning models underpinned by generative AI. We demonstrate our approach using widely-adopted datasets and models employed for image classification, illustrating its effectiveness in generating informative datasets leading up to a 26% increase in widely-used coverage criteria.

KW - Generative AI, Deep Learning Testing, Coverage Guided Fuzzing, Data Augmentation, Safe AI

U2 - 10.1109/ASE56229.2023.00194

DO - 10.1109/ASE56229.2023.00194

M3 - Conference contribution

SN - 979-8-3503-2997-1

T3 - 2023 38th IEEE/ACM International Conference on Automated Software Engineering (ASE)

BT - 2023 38th IEEE/ACM International Conference on Automated Software Engineering

PB - IEEE

T2 - the 38th IEEE/ACM International Conference on Automated Software Engineering

Y2 - 11 September 2023 through 15 September 2023

ER -