QDSB: Quantized Diffusion Schrödinger Bridges
Tobias Fuchs, Florian Kalinke, Nadja Klein
TLDR
QDSB introduces quantized diffusion Schrödinger bridges to efficiently learn generative models from unpaired data, significantly reducing training time.
Key contributions
- Tackles the computational burden of learning simulation-free Schrödinger Bridges with unpaired data.
- Introduces QDSB, computing endpoint couplings on anchor-quantized distributions.
- Lifts the resulting transport plan to original data points through cell-wise sampling.
- Achieves comparable sample quality to baselines while substantially reducing training time.
Why it matters
This paper significantly improves the efficiency of learning generative models using Schrödinger Bridges from unpaired data. By introducing quantization, QDSB drastically reduces the computational cost of optimal transport. This makes powerful generative models more practical and accessible for real-world applications.
Original Abstract
Learning generative models in settings where the source and target distributions are only specified through unpaired samples is gaining in importance. Here, one frequently-used model are Schrödinger bridges (SB), which represent the most likely evolution between both endpoint distributions. To accelerate training, simulation-free SBs avoid the path simulation of the original SB models. However, learning simulation-free SBs requires paired data; a coupling of the source and target samples is obtained as the solution of the entropic optimal transport (OT) problem. As obtaining the optimal global coupling is infeasible in many practical cases, the entropic OT problem is iteratively solved on minibatches instead. Still, the repeated cost remains substantial and the locality can distort the global transport geometry. We propose quantized diffusion Schrödinger bridges (QDSB), which compute the endpoint coupling on anchor-quantized endpoint distributions and lift the resulting plan back to original data points through cell-wise sampling. We show that the regularized optimal coupling is stable w.r.t. anchor quantization, with an error controlled by the quality of the anchor approximation. In real-world experiments, QDSB matches the sample quality of existing baselines, requiring substantially less time. Code and data are available at github.com/mathefuchs/qdsb.
📬 Weekly AI Paper Digest
Get the top 10 AI/ML arXiv papers from the week — summarized, scored, and delivered to your inbox every Monday.