TY - GEN

T1 - Determining Whether a Problem Characteristic Affects Heuristic Performance

AU - Ridge, Enda

AU - Kudenko, Daniel

A2 - Cotta, Carlos

A2 - Hemert, Jano I. van

PY - 2008

Y1 - 2008

N2 - This chapter presents a rigorous Design of Experiments (DOE) approach for determining whether a problem characteristic affects the performance of a heuristic. Specifically, it reports a study on the effect of the cost matrix standard deviation of symmetric Travelling Salesman Problem (TSP) instances on the performance of Ant Colony Optimisation (ACO) heuristics. Results demonstrate that for a given instance size, an increase in the standard deviation of the cost matrix of instances results in an increase in the difficulty of the instances. This implies that for ACO, it is insufficient to report results on problems classified only by problem size, as has been commonly done in most ACO research to date. Some description of the cost matrix distribution is also required when attempting to explain and predict the performance of these heuristics on the TSP. The study should serve as a template for similar investigations with other problems and other heuristics.

AB - This chapter presents a rigorous Design of Experiments (DOE) approach for determining whether a problem characteristic affects the performance of a heuristic. Specifically, it reports a study on the effect of the cost matrix standard deviation of symmetric Travelling Salesman Problem (TSP) instances on the performance of Ant Colony Optimisation (ACO) heuristics. Results demonstrate that for a given instance size, an increase in the standard deviation of the cost matrix of instances results in an increase in the difficulty of the instances. This implies that for ACO, it is insufficient to report results on problems classified only by problem size, as has been commonly done in most ACO research to date. Some description of the cost matrix distribution is also required when attempting to explain and predict the performance of these heuristics on the TSP. The study should serve as a template for similar investigations with other problems and other heuristics.

UR - http://www.scopus.com/inward/record.url?scp=51649106781&partnerID=8YFLogxK

U2 - 10.1007/978-3-540-70807-0_2

DO - 10.1007/978-3-540-70807-0_2

M3 - Conference contribution

VL - 153

T3 - Studies in Computational Intelligence

SP - 21

EP - 35

BT - Recent Advances in Evolutionary Computation for Combinatorial Optimization

PB - Springer

ER -