ArXiv TLDR

End-to-End Identifiable and Consistent Recurrent Switching Dynamical Systems

🐦 Tweet
2605.06315

Carles Balsells-Rodas, Zhengrui Xiang, Xavier Sumba, Yingzhen Li

stat.MLcs.LG

TLDR

This paper introduces ΩSDS, a flow-based estimator for identifiable recurrent switching dynamical systems, improving disentanglement and forecasting.

Key contributions

  • Establishes identifiability for a broad class of recurrent nonlinear switching dynamical systems.
  • Introduces ΩSDS, a flow-based estimator enabling exact likelihood optimization via EM.
  • ΩSDS achieves improved disentanglement compared to existing VAE-based estimators.
  • Demonstrates more accurate forecasting of underlying dynamics on various datasets.

Why it matters

This work overcomes limitations in learning identifiable representations for sequential data with regime-switching dynamics. By providing a theoretically sound and practically effective flow-based estimator, it enables more accurate recovery of latent structures and improved forecasting, crucial for complex real-world systems.

Original Abstract

Learning identifiable representations in deep generative models remains a fundamental challenge, particularly for sequential data with regime-switching dynamics. Existing approaches establish identifiability under restrictive assumptions, such as stationarity or limited emission models, and typically rely on variational autoencoder (VAE) estimators, which introduce approximation gaps that limit the recovery of the latent structure. In this work, we address both the theoretical and practical limitations of this setting. First, we establish identifiability of a broad class of recurrent nonlinear switching dynamical systems under flexible assumptions, significantly extending prior results. Second, we introduce $Ω$SDS, a flow-based estimator that enables exact likelihood optimization using expectation-maximisation. Through empirical validation on both synthetic and real-world data, our results demonstrate that $Ω$SDS achieves improved disentanglement compared to VAE-based estimators and more accurate forecasting of underlying dynamics.

📬 Weekly AI Paper Digest

Get the top 10 AI/ML arXiv papers from the week — summarized, scored, and delivered to your inbox every Monday.