ArXiv TLDR

DINO-Explorer: Active Underwater Discovery via Ego-Motion Compensated Semantic Predictive Coding

🐦 Tweet
2604.12933

Yuhan Jin, Nayari Marie Lessa, Mariela De Lucas Alvarez, Melvin Laux, Lucas Amparo Barbosa + 2 more

cs.ROcs.CV

TLDR

DINO-Explorer enables active underwater discovery by using ego-motion compensated semantic predictive coding to detect novel events efficiently.

Key contributions

  • DINO-Explorer: A novelty-aware perception framework for active underwater discovery.
  • Uses a DINOv3 latent space and action-conditioned predictor for semantic surprise.
  • Ego-motion compensation via optical flow suppresses self-induced visual changes.
  • Reduces telemetry bandwidth by 48.2% while retaining 78.8% of key events.

Why it matters

This paper introduces DINO-Explorer, a system that transforms passive AUVs into active explorers. It significantly improves underwater monitoring by efficiently identifying scientifically valuable, transient events. By filtering out self-induced visual changes, it provides a robust and bandwidth-efficient attention mechanism for marine research.

Original Abstract

Marine ecosystem degradation necessitates continuous, scientifically selective underwater monitoring. However, most autonomous underwater vehicles (AUVs) operate as passive data loggers, capturing exhaustive video for offline review and frequently missing transient events of high scientific value. Transitioning to active perception requires a causal, online signal that highlights significant phenomena while suppressing maneuver-induced visual changes. We propose DINO-Explorer, a novelty-aware perception framework driven by a continuous semantic surprise signal. Operating within the latent space of a frozen DINOv3 foundation model, it leverages a lightweight, action-conditioned recurrent predictor to anticipate short-horizon semantic evolution. An efference-copy-inspired module utilizes globally pooled optical flow to discount self-induced visual changes without suppressing genuine environmental novelty. We evaluate this signal on the downstream task of asynchronous event triage under variant telemetry constraints. Results demonstrate that DINO-Explorer provides a robust, bandwidth-efficient attention mechanism. At a fixed operating point, the system retains 78.8% of post-discovery human-reviewer consensus events with a 56.8% trigger confirmation rate, effectively surfacing mission-relevant phenomena. Crucially, ego-motion conditioning suppresses 45.5% of false positives relative to an uncompensated surprise signal baseline. In a replay-side Pareto ablation study, DINO-Explorer robustly dominates the validated peak F1 versus telemetry bandwidth frontier, reducing telemetry bandwidth by 48.2% at the selected operating point while maintaining a 62.2% peak F1 score, successfully concentrating data transmission around human-verified novelty events.

📬 Weekly AI Paper Digest

Get the top 10 AI/ML arXiv papers from the week — summarized, scored, and delivered to your inbox every Monday.