[IEEE Access] IB-CEMBA: Breaking the Computational Ceiling of Multi-Objective Bi-Level Optimization
Solving Combinatorial Multi-Objective Bi-Level Optimization Problems Using Multiple Populations and Migration Schemes
2020-01-01
Summary
Problem
Method
Results
Takeaways
Abstract
This paper introduces IB-CEMBA (Indicator-Based Co-Evolutionary Migration-Based Algorithm), a novel framework for solving combinatorial Multi-Objective Bi-Level Optimization Problems (MOBPs). It combines indicator-based selection (IBEA/IBMOLS) with a multi-population co-evolutionary scheme to achieve State-Of-The-Art (SOTA) performance in both effectiveness and computational efficiency.
## TL;DR
Bi-level optimization—where one optimization problem is nested inside another—is a computational nightmare, especially when both levels have multiple conflicting objectives. **IB-CEMBA** tackles this by using "indicators" (like Hypervolume) to pick the best follower reactions and a "multi-population migration" strategy to slash the required number of function evaluations (NFEs) by up to 50%.
## The Hierarchical Dilemma: Why Bi-Level is Hard
In a standard Bi-level Optimization Problem (BLOP), the "Leader" (Upper-Level) makes a decision, and the "Follower" (Lower-Level) optimizes their own objectives based on that decision.
**The Pain Point:** In Multi-Objective scenarios, the Follower doesn't just have one optimal response; they have a whole **Pareto Front (PF)**. Existing algorithms usually pick a random solution from this front to send back to the leader. This randomness is disastrous for the leader's gradient/search direction. Furthermore, standard "nested" loops (solving the follower problem from scratch for every leader iteration) lead to an exponential explosion in computational cost.
## Methodology: The Architecture of IB-CEMBA
IB-CEMBA introduces three key innovations to solve these issues:
### 1. Indicator-Based Selection (IBEA & IBMOLS)
Instead of returning a random solution or an entire set, IB-CEMBA uses **Indicators**.
* **Lower-Level:** Uses IBMOLS (Local Search) to find the solution that contributes the *maximum marginal Hypervolume*.
* **Upper-Level:** Uses IBEA to maintain a diverse and converged Pareto Front.
This provides a deterministic, high-quality signal to the leader.
### 2. Population Decomposition & Co-Evolution
To avoid the "nested loop" trap, the algorithm decomposes the search space into two sub-populations per level. Each leader population ($UP_1, UP_2$) works specifically with its corresponding follower population ($LP_1, LP_2$).
### 3. The Migration Scheme
Because the search spaces are interconnected, the optimal follower reaction for a leader in $UP_1$ might actually reside in $LP_2$.
* **The Solution:** A periodic migration strategy checks for "mismatched" solutions and migrates them to the correct population. This ensures the best reactions are always available where they are needed most.

## Experiments: Production-Distribution and ML
The authors tested IB-CEMBA on two distinct domains:
1. **Supply Chain:** A production-distribution problem where the Leader (Distribution Co.) balances transport costs vs. workload, and the Follower (Plant) balances production vs. storage costs.
2. **Machine Learning:** Multi-objective Feature Construction. The leader selects features to minimize error and count, while the follower builds optimized trees for relevance and redundancy.
### Key Results
* **Effectiveness:** IB-CEMBA consistently outperformed IB-CODBA-CRO, IB-CoBRA, and N-NSGA-II in Hypervolume (HV) and Inverted Generational Distance (IGD).
* **Efficiency:** By utilizing the migration scheme, the algorithm achieved a **Reduction Percentage (RP)** of NFEs between **30.13% and 54.09%**.

## Critical Insights & Conclusion
The real genius of IB-CEMBA isn't just "faster math"—it's the **architectural intuition**. By treating the follower's response as a quality-measured contribution rather than a random sample, the leader can actually "learn" the landscape of the bi-level problem.
**Takeaway for Practitioners:** If you are dealing with hierarchical decision-making (like supply chain or automated ML), stop using simple nested GA loops. Moving to an indicator-based co-evolutionary structure can cut your server costs in half while delivering more stable, diverse Pareto sets.
**Limitations:** While effective, the algorithm relies on the Hypervolume indicator, which can become computationally expensive as the number of objectives increases beyond 3 or 4. Future work should explore R2-based or other scalable indicators for high-dimensional MOBPs.
