Hyper-parameter handling for Gaussian processes in efficient global optimization

Bernhard Werth*, Johannes Karder, Andreas Beham, Stefan Wagner

*Korrespondierende/r Autor/-in für diese Arbeit

Publikation: Beitrag in Buch/Bericht/TagungsbandKonferenzbeitragBegutachtung

Abstract

In simulation-based optimization, a common issue with many meta-heuristic algorithms is the limited computational budget. Performing a simulation is usually considerably more time-consuming than evaluating a closed mathematical function. Surrogate-assisted algorithms alleviate this problem by using representative models of the simulation which can be evaluated much faster. One of the most promising surrogate-assisted optimization approaches is Efficient Global Optimization, which uses Gaussian processes as surrogate-models. In this paper, the importance of carefully chosen hyper-parameters for Gaussian process kernels and a way of self-configuration is shown. Based on properties of the training set, e.g. distances between observed points, observed target values, etc., the hyper-parameters of the used kernels are initialized and bounded accordingly. With these initial values and bounds in mind, hyper-parameters are then optimized, which results in improved Gaussian process models that can be used for regression. The goal is to provide an automated way of hyper-parameter initialization, which can be used when building Kriging models in surrogate-assisted algorithms, e.g. Efficient Global Optimization (EGO). Obtained results show that applying the proposed hyper-parameter initialization and bounding can increase the performance of EGO in terms of either convergence speed or achieved objective function value.

OriginalspracheEnglisch
Titel19th International Conference on Modeling and Applied Simulation, MAS 2020
Redakteure/-innenAgostino G. Bruzzone, Fabio De Felice, Marina Massei, Adriano Solis
Herausgeber (Verlag)DIME UNIVERSITY OF GENOA
Seiten60-67
Seitenumfang8
ISBN (elektronisch)9788885741492
DOIs
PublikationsstatusVeröffentlicht - 2020
Veranstaltung19th International Conference on Modeling and Applied Simulation, MAS 2020 - Virtual, Online
Dauer: 16 Sep. 202018 Sep. 2020

Publikationsreihe

Name19th International Conference on Modeling and Applied Simulation, MAS 2020

Konferenz

Konferenz19th International Conference on Modeling and Applied Simulation, MAS 2020
OrtVirtual, Online
Zeitraum16.09.202018.09.2020

Fingerprint

Untersuchen Sie die Forschungsthemen von „Hyper-parameter handling for Gaussian processes in efficient global optimization“. Zusammen bilden sie einen einzigartigen Fingerprint.

Zitieren