From Papers to Progress: Rethinking Knowledge Accumulation in Software Engineering
TLDR
This paper identifies challenges in knowledge accumulation in software engineering and proposes principles for future research artifacts to foster cumulative progress.
Key contributions
- Analyzes ICSE 2026 pre-survey responses from 280 researchers on knowledge accumulation challenges.
- Diagnoses four structural breakdowns: isolated papers, lost context, untracked claims, and novelty incentives.
- Proposes four principles for future research artifacts: structured claims, inspectable provenance, long-lived substrates, and aligned incentives.
- Discusses implications for research practice, publication norms, and community infrastructure.
Why it matters
This paper critically examines the current state of knowledge accumulation in software engineering, highlighting systemic issues that hinder progress. By proposing concrete principles for evolving research artifacts, it offers a roadmap for fostering more cumulative and integrated scientific understanding. This is crucial for the field's long-term development.
Original Abstract
Software engineering research has experienced rapid growth in both output and participation over the past decades. Yet concerns persist about the field's ability to accumulate, integrate, and reuse knowledge in ways that support long-term progress. To better understand how the community itself perceives these challenges, we analyze responses from the ICSE 2026 Future of Software Engineering pre-survey, which captures perspectives from 280 globally distributed and highly experienced researchers. Our analysis reveals a tension between increasing research productivity and the limited mechanisms available for synthesizing results, tracking evolving claims, and supporting cumulative understanding over time. Building on these observations, we diagnose four interrelated structural breakdowns: papers function as isolated knowledge units with claims embedded in prose; context and provenance are lost as knowledge moves through the publication pipeline; claims evolve without systematic tracking; and incentive structures favor novelty over consolidation. We argue that addressing these barriers requires rethinking the fundamental properties of research artifacts. We articulate four technology-agnostic principles for future research artifacts: structured and interpretable representations of claims and evidence; inspectable and provenance-aware documentation of methodological decisions; long-lived and reusable substrates that evolve beyond publication; and governance mechanisms that align individual incentives with collective knowledge-building goals. We discuss implications for research practice, publication norms, and community infrastructure, positioning FOSE as a venue for experimenting with alternative artifact designs that support cumulative scientific progress.
📬 Weekly AI Paper Digest
Get the top 10 AI/ML arXiv papers from the week — summarized, scored, and delivered to your inbox every Monday.