Optimization Days 2024
HEC Montréal, Québec, Canada, 6 — 8 May 2024
![](/assets/cal-add-6d138cf3e30399796b32f524ba2175862f0503314e61a73e25c8269466c9e3d9.png)
TA1 - Tutorial 3
May 7, 2024 10:30 AM – 12:10 PM
Location: Walter Capital (blue)
Chaired by Okan Arslan
1 Presentation
-
10:30 AM - 12:10 PM
Combinatorial Optimization for Trustworthy Machine Learning
The use of decision-support systems and machine learning algorithms in finance, medicine, and many other domains can profoundly impact human lives. Consequently, extensive efforts have been made to improve machine learning pipelines, e.g., making them more accurate, robust, and interpretable. In this tutorial, we discuss the synergy between combinatorial optimization and machine learning. We focus primarily on tree ensembles (including random forests and gradient boosting), a popular family of models with good empirical performance which is often used as a more transparent replacement to neural networks. We discuss the use of dynamic programming algorithms for simplifying tree ensembles. We also show that the search for counterfactual explanations (i.e., small and plausible perturbations of the input that modify the classification outcome) can be cast as a mixed integer program and efficiently solved. Finally, we use constraint programming to highlight privacy vulnerabilities in trained models. We conclude the talk with various research perspectives.