Distributed ACO: Leveraging Crowdsourcing to Solve Continuous Multiobjective Problems

Distributed ACO based on a crowdsourcing model for multiobjective problem

2017-04-01
Jiaqi Lu, Li Pan, Shijun Liu, Xinyan Liu
Summary
Problem
Method
Results
Takeaways
Abstract

This paper introduces a distributed Ant Colony Optimization (ACO) algorithm tailored for continuous Multiobjective Optimization Problems (MOPs) by integrating a crowdsourcing-inspired decomposition model. The approach, based on MOEA/D principles, successfully approximates the Pareto Front for the KUR test problem by distributing subtasks across a network of collaborative nodes.

TL;DR

This research presents a novel framework that bridges Ant Colony Optimization (ACO) and Crowdsourcing to tackle continuous Multiobjective Optimization Problems (MOPs). By decomposing a complex MOP into simpler single-objective subtasks distributed across a network, the authors achieve a robust approximation of the Pareto Front, specifically optimized for continuous domains.

Background: The Scalability Wall in MOPs

Multiobjective Optimization usually involves internal conflicts—improving one objective often degrades another. Traditionally, Evolutionary Algorithms (MOEAs) have been the go-to solution. However, as we move from discrete tasks (like the Knapsack Problem) to Continuous MOPs, the search space becomes infinite. A single machine often struggles with the computational load required to find a diverse and accurate Pareto Front.

The authors identify a synergy between Decomposition-based algorithms (MOEA/D) and Crowdsourcing models, where a massive task is solved by the "wisdom of the crowd"—or in this case, the collective power of distributed CPUs.

Methodology: Innovation Through Decomposition

The core of the paper lies in three strategic enhancements to the standard ACO process:

1. Discretization and Decomposition

The continuous domain is first discretized using a stride length . Then, the Tchebycheff approach is used to decompose the MOP into scalar optimization subproblems, each defined by a unique weight vector.

2. The PersonalScope Strategy

To prevent ants from wandering uselessly in a "massively wide" domain, the authors introduced PersonalScope. Each ant is restricted to a subset of the domain.

  • Top-performing ants keep their scope.
  • Underperformers must adapt or inherit scopes from the "elite" ants. This introduces a selection pressure similar to natural evolution, focusing the search on promising regions.

3. Predictive Heuristic Factor

Standard ACO requires a heuristic value () to make probabilistic choices. In continuous MOPs, calculating for a partial solution is difficult. The authors propose a Predictive Method: using the current best-known solution of the colony to "fill in the blanks" of a partial ant path, allowing for an immediate estimation of the objective value.

Process Model Fig 1: The Process Model showing roles of Crowdsourcer, Task Manager, and the Crowd.

Distributed Infrastructure

The paper simplifies the crowdsourcing model into four roles:

  • Crowdsourcer: Defines the MOP.
  • Task Manager: Decomposes the task and manages neighbors.
  • Crowd: Distributed threads/machines that run the ACO process on specific subproblems.
  • Evaluation Engine: Aggregates results to form the final Pareto Front.

Structural Model of the Crowd Fig 2: Visualization of how individual threads contribute to the global optimization goal.

Experimental Validation: The KUR Problem

The team tested their approach on the KUR problem, a well-known benchmark for continuous MOPs.

Key Results:

  • Hardware: 6 computers (30 subtasks each).
  • Total Time: ~321 seconds.
  • Outcome: The algorithm successfully converged to a representative Pareto Front.

One interesting finding was the Solution Diminution phenomenon. As iterations progressed, many subproblems converged to solutions shared by their neighbors. While this improved local optimization, it actually reduced the total number of unique non-dominated solutions in the global set (as shown in the figure below).

Pareto Front Evolution Fig 3: The reduction of unique non-dominated solutions over iterations (200 to 1000).

Critical Insight & Conclusion

The study proves that ACO is not just for the Traveling Salesman Problem; with the right discretization and decomposition, it is a powerhouse for continuous optimization.

Future Outlook: The "diminution" of solutions suggests that in distributed optimization, we should harvest "intermediate" good solutions frequently, rather than just waiting for the final convergence. This "early harvesting" could prevent the loss of diverse Pareto candidates that are globally non-dominated even if they aren't the local optima for a specific sub-task.

Ultimately, this work provides a practical blueprint for deploying swarm intelligence across distributed networks to solve the world's "dilemma-style" decision problems.

Find Similar Papers

Try Our Examples

  • Search for recent papers that utilize MOEA/D-ACO architectures for large-scale continuous optimization in high-dimensional spaces.
  • Which seminal work first established the Tchebycheff decomposition method for multiobjective optimization, and how has this paper modified it for distributed ant colony systems?
  • Explore the application of crowdsourced evolutionary algorithms in real-world scenarios such as industrial supply chain optimization or complex network routing.
Contents
Distributed ACO: Leveraging Crowdsourcing to Solve Continuous Multiobjective Problems
1. TL;DR
2. Background: The Scalability Wall in MOPs
3. Methodology: Innovation Through Decomposition
3.1. 1. Discretization and Decomposition
3.2. 2. The PersonalScope Strategy
3.3. 3. Predictive Heuristic Factor
4. Distributed Infrastructure
5. Experimental Validation: The KUR Problem
6. Critical Insight & Conclusion