Finding Knees in Bayesian Multi-objective Optimization

Heidari, Arash and Qing, Jixiang and Gonzalez, Sebastian Rojas and Branke, Jürgen and Dhaene, Tom and Couckuyt, Ivo (2022) Finding Knees in Bayesian Multi-objective Optimization. In: Parallel Problem Solving from Nature – PPSN XVII : 17th International Conference, PPSN 2022, Dortmund, Germany, September 10–14, 2022, Proceedings, Part I. Lecture Notes in Computer Science . Springer, Cham, pp. 104-117. ISBN 9783031147135

Abstract

Multi-objective optimization requires many evaluations to identify a sufficiently dense approximation of the Pareto front. Especially for a higher number of objectives, extracting the Pareto front might not be easy nor cheap. On the other hand, the Decision-Maker is not always interested in the entire Pareto front, and might prefer a solution where there is a desirable trade-off between different objectives. An example of an attractive solution is the knee point of the Pareto front, although the current literature differs on the definition of a knee. In this work, we propose to detect knee solutions in a data-efficient manner (i.e., with a limited number of time-consuming evaluations), according to two definitions of knees. In particular, we propose several novel acquisition functions in the Bayesian Optimization framework for detecting these knees, which allows for scaling to many objectives. The suggested acquisition functions are evaluated on various benchmarks with promising results.