ArXiv TLDR

MAGS-SLAM: Monocular Multi-Agent Gaussian Splatting SLAM for Geometrically and Photometrically Consistent Reconstruction

🐦 Tweet
2605.10760

Zhihao Cao, Qi Shao, Shuhao Zhai, Jing Zhang, Anh Nguyen + 1 more

cs.RO

TLDR

MAGS-SLAM is the first RGB-only multi-agent 3D Gaussian Splatting SLAM for collaborative, photorealistic 3D reconstruction without depth sensors.

Key contributions

  • Introduces MAGS-SLAM, the first RGB-only multi-agent 3D Gaussian Splatting SLAM framework.
  • Enables collaborative reconstruction by transmitting compact submap summaries, not raw data, between agents.
  • Integrates geometry/appearance-aware loop verification and occupancy-aware Gaussian fusion for consistency.

Why it matters

This work overcomes the limitations of RGB-D sensor reliance in multi-agent 3DGS SLAM, enabling deployment on lightweight, low-cost platforms. It offers a robust monocular solution for large-scale collaborative 3D reconstruction, critical for virtual production and multi-robot exploration.

Original Abstract

Collaborative photorealistic 3D reconstruction from multiple agents enables rapid large-scale scene capture for virtual production and cooperative multi-robot exploration. While recent 3D Gaussian Splatting (3DGS) SLAM algorithms can generate high-fidelity real-time mapping, most of the existing multi-agent Gaussian SLAM methods still rely on RGB-D sensors to obtain metric depth and simplify cross-agent alignment, which limits the deployment on lightweight, low-cost, or power-constrained robotic platforms. To address this challenge, we propose MAGS-SLAM, the first RGB-only multi-agent 3DGS SLAM framework for collaborative scene reconstruction. Each agent independently builds local monocular Gaussian submaps and transmits compact submap summaries rather than raw observations or dense maps. To facilitate robust collaboration in the presence of monocular scale ambiguity, our framework integrates compact submap communication, geometry- and appearance-aware loop verification, and occupancy-aware Gaussian fusion, enabling coherent global reconstruction without active depth sensors. We further introduce ReplicaMultiagent Plus benchmark for evaluating collaborative Gaussian SLAM. Intensive experiments on synthetic and real-world datasets show that MAGS-SLAM achieves competitive tracking accuracy and comparable or superior rendering quality to state-of-the-art RGB-D collaborative Gaussian SLAM methods while relying only RGB images.

📬 Weekly AI Paper Digest

Get the top 10 AI/ML arXiv papers from the week — summarized, scored, and delivered to your inbox every Monday.