Determining Whether a Problem Characteristic Affects Heuristic Performance A Rigorous Design of Experiments Approach

Enda Ridge, Daniel Kudenko

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This chapter presents a rigorous Design of Experiments (DOE) approach for determining whether a problem characteristic affects the performance of a heuristic. Specifically, it reports a study on the effect of the cost matrix standard deviation of symmetric Travelling Salesman Problem (TSP) instances on the performance of Ant Colony Optimisation (ACO) heuristics. Results demonstrate that for a given instance size, an increase in the standard deviation of the cost matrix of instances results in all increase in the difficulty of the instances. This implies that for ACO, it is insufficient to report results on problems classified only by problem size, as has been commonly done in most ACO research to date. Some description of the cost matrix distribution is also required when attempting to explain and predict the performance of these heuristics on the TSP. The study should serve as a template for similar investigations with other problems and other heuristics.

Original languageEnglish
Title of host publicationRECENT ADVANCES IN EVOLUTIONARY COMPUTATION FOR COMBINATORIAL OPTIMIZATION
EditorsC Cotta, J VanHemert
Place of PublicationNEW YORK
PublisherSpringer
Pages21-35
Number of pages15
ISBN (Print)978-3-540-70806-3
Publication statusPublished - 2008
Event7th European Conference on Evolutionary Computation in Combinatorial Optimization (EvoCOP 2007) - Valencia
Duration: 11 Apr 200713 Apr 2007

Conference

Conference7th European Conference on Evolutionary Computation in Combinatorial Optimization (EvoCOP 2007)
CityValencia
Period11/04/0713/04/07

Keywords

  • Design of Experiments
  • Nest Hierarchical Design
  • Problem Difficulty
  • Ant Colony Optimisation

Cite this