TY - JOUR
T1 - Efficient computation of expected hypervolume improvement using box decomposition algorithms
AU - Yang, Kaifeng
AU - Emmerich, Michael
AU - Deutz, André
AU - Bäck, Thomas
N1 - Publisher Copyright:
© 2019, The Author(s).
PY - 2019/9/1
Y1 - 2019/9/1
N2 - In the field of multi-objective optimization algorithms, multi-objective Bayesian Global Optimization (MOBGO) is an important branch, in addition to evolutionary multi-objective optimization algorithms. MOBGO utilizes Gaussian Process models learned from previous objective function evaluations to decide the next evaluation site by maximizing or minimizing an infill criterion. A commonly used criterion in MOBGO is the Expected Hypervolume Improvement (EHVI), which shows a good performance on a wide range of problems, with respect to exploration and exploitation. However, so far, it has been a challenge to calculate exact EHVI values efficiently. This paper proposes an efficient algorithm for the exact calculation of the EHVI for in a generic case. This efficient algorithm is based on partitioning the integration volume into a set of axis-parallel slices. Theoretically, the upper bound time complexities can be improved from previously O(n2) and O(n3) , for two- and three-objective problems respectively, to Θ(nlog n) , which is asymptotically optimal. This article generalizes the scheme in higher dimensional cases by utilizing a new hyperbox decomposition technique, which is proposed by Dächert et al. (Eur J Oper Res 260(3):841–855, 2017). It also utilizes a generalization of the multilayered integration scheme that scales linearly in the number of hyperboxes of the decomposition. The speed comparison shows that the proposed algorithm in this paper significantly reduces computation time. Finally, this decomposition technique is applied in the calculation of the Probability of Improvement (PoI).
AB - In the field of multi-objective optimization algorithms, multi-objective Bayesian Global Optimization (MOBGO) is an important branch, in addition to evolutionary multi-objective optimization algorithms. MOBGO utilizes Gaussian Process models learned from previous objective function evaluations to decide the next evaluation site by maximizing or minimizing an infill criterion. A commonly used criterion in MOBGO is the Expected Hypervolume Improvement (EHVI), which shows a good performance on a wide range of problems, with respect to exploration and exploitation. However, so far, it has been a challenge to calculate exact EHVI values efficiently. This paper proposes an efficient algorithm for the exact calculation of the EHVI for in a generic case. This efficient algorithm is based on partitioning the integration volume into a set of axis-parallel slices. Theoretically, the upper bound time complexities can be improved from previously O(n2) and O(n3) , for two- and three-objective problems respectively, to Θ(nlog n) , which is asymptotically optimal. This article generalizes the scheme in higher dimensional cases by utilizing a new hyperbox decomposition technique, which is proposed by Dächert et al. (Eur J Oper Res 260(3):841–855, 2017). It also utilizes a generalization of the multilayered integration scheme that scales linearly in the number of hyperboxes of the decomposition. The speed comparison shows that the proposed algorithm in this paper significantly reduces computation time. Finally, this decomposition technique is applied in the calculation of the Probability of Improvement (PoI).
KW - Expected hypervolume improvement
KW - Hypervolume indicator
KW - Kriging
KW - Multi-objective Bayesian global optimization
KW - Probability of improvement
KW - Time complexity
UR - http://www.scopus.com/inward/record.url?scp=85068828472&partnerID=8YFLogxK
U2 - 10.1007/s10898-019-00798-7
DO - 10.1007/s10898-019-00798-7
M3 - Article
AN - SCOPUS:85068828472
SN - 0925-5001
VL - 75
SP - 3
EP - 34
JO - Journal of Global Optimization
JF - Journal of Global Optimization
IS - 1
ER -