Anytime Analysis on BinVal: Adaptive Parameters Help
TLDR
This paper analyzes the anytime performance of randomized search heuristics on BinVal, showing adaptive mutation rates significantly improve optimization time.
Key contributions
- Analyzes fixed-target run time for optimizing `k` most significant bits on BinVal, simultaneously for all `k`.
- Shows the (1+1) EA with fixed `1/n` mutation rate has `Θ(n log k)` run time on BinVal.
- Demonstrates the sig-cGA (EDA) achieves `Θ(k log n)` expected evaluations on BinVal.
- Proves a self-adjusting (1+1) EA achieves `O(k^(1+ε))` run time, independent of `n`.
Why it matters
This research is crucial for understanding the practical performance of randomized search heuristics, especially when the target quality `k` is unknown. The finding that adaptive mutation rates can achieve `n`-independent run times highlights the power of self-adjusting algorithms, leading to more robust and efficient optimization strategies.
Original Abstract
While most theoretical run time analyses of discrete randomized search heuristics provide bounds on the expected number of evaluations to find the global optimum, we consider the anytime performance of evolutionary and estimation-of-distribution algorithms. For this purpose, we analyze the fixed-target run time of various algorithms using BinVal as fitness function and bound the run time to optimize the most significant $k \in o(n)$ bits of a bit string with length $n$. We analyze the run times such that they hold not only for a fixed $k$, but simultaneously for all $k \in o(n)$. For the standard (1+1) EA with fixed mutation rate $1/n$, we show that the fixed-target run time for all $k \in o(n)$ is in $Θ(n \log k)$. Using an EDA instead, we get an expected number of evaluations of $Θ(k \log n)$ for the sig-cGA. Replacing in the standard (1+1) EA the fixed mutation rate with a self-adjusting rate, we show that the fixed-target run time for $k \in o(n)$ and a constant $\varepsilon >0$ arbitrarily close to zero is in $\mathcal{O}\left(k^{1+\varepsilon}\right)$ for this algorithm. In particular, this run time is independent of $n$, holds simultaneously for all $k \in o(n)$, and is close to the run time of $Θ(k \log k)$ for the (1+1) EA with the best fixed mutation rate if $k$ is known.
📬 Weekly AI Paper Digest
Get the top 10 AI/ML arXiv papers from the week — summarized, scored, and delivered to your inbox every Monday.