Explaining the "Why": A Unified Framework for the Additive Attribution of Changes in Arbitrary Measures
Changsheng Zhou, Dajun Chen, Zhitao Shen, wei jiang, Yong Li + 1 more
TLDR
This paper introduces a unified, game theory-based framework to explain why aggregated measures change, offering general and rigorous attribution.
Key contributions
- Introduces a unified framework for explaining changes in aggregated measures.
- Reframes attribution using cooperative game theory for principled interpretability.
- Classifies measures by mathematical structure to enable tailored attribution algorithms.
- Demonstrates superior accuracy, generality for non-additive measures, and practical utility.
Why it matters
Existing data analytics systems struggle to explain why aggregated measures change. This framework provides a general, holistic, and rigorously interpretable solution, bridging a critical gap. It significantly outperforms current root cause analysis systems, making it highly practical for data analysts.
Original Abstract
Explaining why aggregated measures change is a critical challenge in data analytics that existing systems struggle to address. While current attribution methods exist, they lack a unified solution that is simultaneously general for arbitrary measures, holistic across both data dimensions and measure composition, and rigorous in its interpretability. To bridge this gap, we introduce a principled framework that reframes attribution through the powerful lens of cooperative game theory. Our key contribution is a classification of measures based on their mathematical structure, which enables a spectrum of algorithms-from general approximations to exact, closed-form solutions-that offer a principled trade-off between generality and performance. We demonstrate our framework's superiority through a multi-faceted evaluation: simulations first confirm its numerical accuracy and then its generality for non-additive measures; a case study on Simpson's Paradox showcases its unique interpretability; and a final experiment proves its practical utility by significantly outperforming existing root cause analysis systems.
📬 Weekly AI Paper Digest
Get the top 10 AI/ML arXiv papers from the week — summarized, scored, and delivered to your inbox every Monday.