Semantic Data Augmentation for Deep Learning Testing using Generative AI

Sondess Missaoui, Simos Gerasimou*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

he performance of state-of-the-art Deep Learning models heavily depends on the availability of well-curated training and testing datasets that sufficiently capture the operational domain. Data augmentation is an effective technique in alleviating data scarcity, reducing the time-consuming and expensive data collection and labelling processes. Despite their potential, existing data augmentation techniques primarily focus on simple geometric and colour space transformations, like noise, flipping and resizing, producing datasets with limited diversity. When the augmented dataset is used for testing the Deep Learning models, the derived results are typically uninformative about the robustness of the models. We address this gap by introducing GENFUZZER, a novel coverage-guided data augmentation fuzzing technique for Deep Learning models underpinned by generative AI. We demonstrate our approach using widely-adopted datasets and models employed for image classification, illustrating its effectiveness in generating informative datasets leading up to a 26% increase in widely-used coverage criteria.
Original languageEnglish
Title of host publication38th IEEE/ACM International Conference on Automated Software Engineering
Subtitle of host publicationProceedings
PublisherIEEE
Number of pages5
Publication statusPublished - 15 Sept 2023
Eventthe 38th IEEE/ACM International Conference on Automated Software Engineering - Kirchberg, Luxembourg, Kirchberg, Luxembourg
Duration: 11 Sept 202315 Sept 2023
https://conf.researchr.org/home/ase-2023

Conference

Conferencethe 38th IEEE/ACM International Conference on Automated Software Engineering
Abbreviated titleASE 2023
Country/TerritoryLuxembourg
CityKirchberg
Period11/09/2315/09/23
Internet address

Bibliographical note

This is an author-produced version of the published paper. Uploaded in accordance with the University’s Research Publications and Open Access policy.

Keywords

  • Generative AI, Deep Learning Testing, Coverage Guided Fuzzing, Data Augmentation, Safe AI

Cite this