ArXiv TLDR

XRZero-G0: Pushing the Frontier of Dexterous Robotic Manipulation with Interfaces, Quality and Ratios

🐦 Tweet
2604.13001

Junming Wang, Teng Pu, Wingmun Fung, Jindong Wang, Shanchang Wang + 17 more

cs.RO

TLDR

XRZero-G0 is a hardware-software system that enables scalable, high-quality robot-free data collection for dexterous manipulation, reducing costs significantly.

Key contributions

  • Introduces XRZero-G0, a VR-based system with ergonomic hardware for efficient, high-quality robot-free data collection.
  • Proposes a closed-loop data pipeline ensuring 85% validity for non-proprioceptive data, improving reliability.
  • Shows that a 10:1 mix of robot-free to real-robot data matches performance, cutting costs by 20x.
  • Created a 2,000-hour robot-free dataset enabling zero-shot transfer to physical robots for manipulation.

Why it matters

This paper tackles the critical bottleneck of acquiring high-quality demonstration data for dexterous robot manipulation. XRZero-G0 provides a scalable, cost-effective solution by leveraging robot-free data with a novel system and pipeline. It significantly reduces data acquisition costs while enabling zero-shot transfer for generalized real-world tasks.

Original Abstract

The acquisition of high-quality, action-aligned demonstration data remains a fundamental bottleneck in scaling foundation models for dexterous robot manipulation. Although robot-free human demonstrations (e.g., the UMI paradigm) offer a scalable alternative to traditional teleoperation, current systems are constrained by sub-optimal hardware ergonomics, open-loop workflows, and a lack of systematic data-mixing strategies. To address these limitations, we present XRZero-G0, a hardware-software co-designed system for embodied data collection and policy learning. The system features an ergonomic, virtual reality interface equipped with a top-view camera and dual specialized grippers to directly improve collection efficiency. To ensure dataset reliability, we propose a closed-loop collection, inspection, training, and evaluation pipeline for non-proprioceptive data. This workflow achieves an 85% data validity rate and establishes a transparent mechanism for quality control. Furthermore, we investigate the empirical scaling behaviors and optimal mixing ratios of robot-free data. Extensive experiments indicate that combining a minimal volume of real-robot data with large-scale robot-free data (e.g., a 10:1 ratio) achieves performance comparable to exclusively real-robot datasets, while reducing acquisition costs by a factor of twenty. Utilizing XRZero-G0, we construct a 2,000-hour robot-free dataset that enables zero-shot cross-embodiment transfer to a target physical robot, demonstrating a highly scalable methodology for generalized real-world manipulation.Our project repository: https://github.com/X-Square-Robot/XRZero-G0

📬 Weekly AI Paper Digest

Get the top 10 AI/ML arXiv papers from the week — summarized, scored, and delivered to your inbox every Monday.