Better GP Benchmarks: Community Survey Results and Proposals

David R. White, James McDermott, Mauro Castelli, Luca Manzoni, Brian Goldman, Gabriel Kronberger, Wojciech Jaskowski, Una-May O'Reilly, Sean Luke

Research output: Contribution to journalReview articlepeer-review

193 Citations (Scopus)

Abstract

We present the results of a community survey regarding genetic programming benchmark practices. Analysis shows broad consensus that improvement is needed in problem selection and experimental rigor. While views expressed in the survey dissuade us from proposing a large-scale benchmark suite, we find community support for creating a "blacklist" of problems which are in common use but have important flaws, and whose use should therefore be discouraged. We propose a set of possible replacement problems.

Original languageEnglish
Pages (from-to)3-29
Number of pages27
JournalGenetic Programming and Evolvable Machines
Volume14
Issue number1
DOIs
Publication statusPublished - Mar 2013

Keywords

  • Benchmarks
  • Community survey
  • Genetic programming

Fingerprint

Dive into the research topics of 'Better GP Benchmarks: Community Survey Results and Proposals'. Together they form a unique fingerprint.

Cite this