By the same authors

On the Predictability of Random Tests for Object-Oriented Software

Research output: Contribution to conferencePaper

Author(s)

  • Ilinca Ciupa
  • Alexander Pretschner
  • Andreas Leitner
  • Manuel Oriol
  • Bertrand Meyer

Department/unit(s)

Publication details

DatePublished - 1 Apr 2008
Original languageUndefined/Unknown

Abstract

Intuition suggests that random testing of object-oriented programs should exhibit a significant difference in the number of faults detected by two different runs of equal duration. As a consequence, random testing would be rather unpredictable. We evaluate the variance of the number of faults detected by random testing over time. We present the results of an empirical study that is based on 1215 hours of randomly testing 27 Eiffel classes, each with 30 seeds of the random number generator. Analyzing over 6 million failures triggered during the experiments, the study provides evidence that the relative number of faults detected by random testing over time is predictable but that different runs of the random test case generator detect different faults. The study also shows that random testing quickly finds faults: the first failure is likely to be triggered within 30 seconds.

???prize-relations???

Discover related content

Find related publications, people, projects, datasets and more using interactive charts.

View graph of relations