TY - CHAP

T1 - Infill criteria for multiobjective bayesian optimization

AU - Emmerich, Michael T.M.

AU - Yang, Kaifeng

AU - Deutz, André H.

N1 - Publisher Copyright:
© Springer Nature Switzerland AG 2020.

PY - 2020

Y1 - 2020

N2 - Bayesian Global Optimization (BGO) (also referred to as Bayesian Optimization, or Efficient Global Optimization (EGO)), uses statistical models—typically Gaussian process regression to approximate an expensive objective function. Based on this prediction an infill criterion is formulated that takes into account the expected value and variance. BGO adds a new point at the position where this infill criterion obtains its optimum. In this chapter, we will review different ways to formulate such infill criteria. A focus will be on approaches that measure improvement utilizing integrals or statistical moments of a probability distribution over the non-dominated space, including the probability of improvement and the expected hypervolume improvement, and upper quantiles of the hypervolume improvement. These criteria require the solution of non-linear integral calculations. Besides summarizing the progress in the computation of such integrals, we will present new, efficient, procedures for the high dimensional expected improvement and probability of improvement. Moreover, the chapter will summarize main properties of these infill criteria, including continuity and differentiability as well as monotonicity properties of the variance and mean value. The latter will be necessary for constructing global optimization algorithms for non-convex problems.

AB - Bayesian Global Optimization (BGO) (also referred to as Bayesian Optimization, or Efficient Global Optimization (EGO)), uses statistical models—typically Gaussian process regression to approximate an expensive objective function. Based on this prediction an infill criterion is formulated that takes into account the expected value and variance. BGO adds a new point at the position where this infill criterion obtains its optimum. In this chapter, we will review different ways to formulate such infill criteria. A focus will be on approaches that measure improvement utilizing integrals or statistical moments of a probability distribution over the non-dominated space, including the probability of improvement and the expected hypervolume improvement, and upper quantiles of the hypervolume improvement. These criteria require the solution of non-linear integral calculations. Besides summarizing the progress in the computation of such integrals, we will present new, efficient, procedures for the high dimensional expected improvement and probability of improvement. Moreover, the chapter will summarize main properties of these infill criteria, including continuity and differentiability as well as monotonicity properties of the variance and mean value. The latter will be necessary for constructing global optimization algorithms for non-convex problems.

UR - http://www.scopus.com/inward/record.url?scp=85066924949&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-18764-4_1

DO - 10.1007/978-3-030-18764-4_1

M3 - Chapter

AN - SCOPUS:85066924949

T3 - Studies in Computational Intelligence

SP - 3

EP - 16

BT - Studies in Computational Intelligence

PB - Springer-Verlag Italia Srl

ER -