ArXiv TLDR

From Research to Practice: An Interactive Rapid Review of Autonomous Driving System Testing in Industry

🐦 Tweet
2605.00531

Qunying Song, Ali Nouri, Håkan Sivencrona, Federica Sarro

cs.SE

TLDR

This paper reviews autonomous driving system testing challenges in industry, identifying key issues and evaluating research applicability.

Key contributions

  • Conducted a practitioner-driven review of ADS testing challenges with 21 industry experts.
  • Identified 12 key ADS testing challenges, prioritizing End-to-End (E2E) testing completeness.
  • Assessed 17 relevant research studies, highlighting their applicability and gaps for industry practice.

Why it matters

This study bridges the gap between academic research and industrial practice in autonomous driving system testing. It provides practitioner-driven insights into real-world challenges, highlighting the need for more context-aware, industry-relevant solutions. This is crucial for advancing ADS deployment.

Original Abstract

Autonomous driving systems (ADS) are increasingly deployed in real traffic, yet testing remains fundamentally challenging due to open environments, complex scenarios, and the lack of established processes and metrics. Despite extensive research, a gap persists between academic advances and their applicability in industrial practice. To address this, we conduct an interactive rapid review in collaboration with 21 practitioners from a leading automotive company. Practitioners identified 12 key challenges in ADS testing, and prioritised two as the most critical issues, namely approaches to and completeness of testing for End-to-End (E2E) ADS. We analyzed 17 research studies relevant to these two challenges, most of which focus on generating critical testing scenarios, and subsequently assessed their relevance and applicability in practice. Our study provides the first practitioner-driven review and evaluation of current ADS testing research, reveals practical challenges in ADS testing, offers rapid insights for practitioners, and highlights the need for more context-aware, industry-relevant solutions to bridge the gap between research and practice.

📬 Weekly AI Paper Digest

Get the top 10 AI/ML arXiv papers from the week — summarized, scored, and delivered to your inbox every Monday.