Continuous surrogate-based optimization algorithms are well-suited for expensive discrete problems

التفاصيل البيبلوغرافية
العنوان: Continuous surrogate-based optimization algorithms are well-suited for expensive discrete problems
المؤلفون: Karlsson, Rickard, Bliek, Laurens, Verwer, Sicco, de Weerdt, Mathijs
المصدر: Proceedings of BNAIC/BeneLearn (2020), 88-102
سنة النشر: 2020
المجموعة: Computer Science
Mathematics
مصطلحات موضوعية: Mathematics - Optimization and Control, Computer Science - Machine Learning
الوصف: One method to solve expensive black-box optimization problems is to use a surrogate model that approximates the objective based on previous observed evaluations. The surrogate, which is cheaper to evaluate, is optimized instead to find an approximate solution to the original problem. In the case of discrete problems, recent research has revolved around surrogate models that are specifically constructed to deal with discrete structures. A main motivation is that literature considers continuous methods, such as Bayesian optimization with Gaussian processes as the surrogate, to be sub-optimal (especially in higher dimensions) because they ignore the discrete structure by, e.g., rounding off real-valued solutions to integers. However, we claim that this is not true. In fact, we present empirical evidence showing that the use of continuous surrogate models displays competitive performance on a set of high-dimensional discrete benchmark problems, including a real-life application, against state-of-the-art discrete surrogate-based methods. Our experiments on different discrete structures and time constraints also give more insight into which algorithms work well on which type of problem.
Comment: 16 pages, 3 figures; added keywords, typos corrected, additional information in Figure 3 but results unchanged
نوع الوثيقة: Working Paper
DOI: 10.1007/978-3-030-76640-5_4
URL الوصول: http://arxiv.org/abs/2011.03431
رقم الأكسشن: edsarx.2011.03431
قاعدة البيانات: arXiv
الوصف
DOI:10.1007/978-3-030-76640-5_4