ArXiv TLDR

Information-geometric adaptive sampling for graph diffusion

🐦 Tweet
2605.00250

Yuhui Lu, Wenjing Liu, Kun Zhan

stat.MLcs.CVcs.LG

TLDR

DVS, an information-geometric adaptive sampler for graph diffusion, ensures constant informational speed, significantly boosting generation efficiency and structural fidelity.

Key contributions

  • Proposes an information-geometric framework for graph diffusion, viewing trajectories as curves on a Riemannian manifold.
  • Introduces the Drift Variation Score (DVS), derived from the Fisher-Rao metric, to quantify distributional change.
  • DVS enforces a constant informational speed, ensuring uniform contribution of information per sampling step.
  • Achieves significant improvements in structural fidelity and sampling efficiency for graph generation tasks.

Why it matters

Standard graph diffusion models struggle with non-homogeneous dynamics, leading to inefficiencies. This paper offers a principled, geometry-aware solution by ensuring a constant informational speed. DVS makes sampling more efficient and generates higher-quality graphs, addressing a key limitation in current methods.

Original Abstract

Standard diffusion models for graph generation typically rely on uniform time-stepping, an approach that overlooks the non-homogeneous dynamics of distributional evolution on complex manifolds. In this paper, we present an information-geometric framework that reinterprets the diffusion sampling trajectory as a parametric curve on a Riemannian manifold. Our key observation is that the Fisher-Rao metric provides a principled measure of the intrinsic distance. By analyzing this metric, we derive the Drift Variation Score (DVS), a geometry-aware indicator that quantifies the instantaneous rate of distributional change. Unlike prior heuristic-based adaptive samplers, our DVS solver enforces a constant informational speed on the statistical manifold, automatically maintaining a uniform rate of distributional change along the sampling trajectory. This equal arc-length strategy ensures that each discretization step contributes equally to the information speed. Theoretical analysis verifies that DVS characterizes the local stiffness of the sampling dynamics in the Fisher-Rao sense. Experimental results on molecule and social network generation show that DVS significantly improves structural fidelity and sampling efficiency. Code is at https://github.com/kunzhan/DVS

📬 Weekly AI Paper Digest

Get the top 10 AI/ML arXiv papers from the week — summarized, scored, and delivered to your inbox every Monday.