ArXiv TLDR

Retrieval Is Not Enough: Why Organizational AI Needs Epistemic Infrastructure

🐦 Tweet
2604.11759

Federico Bottino, Carlo Ferrero, Nicholas Dosio, Pierfrancesco Beneventano

cs.AI

TLDR

This paper introduces OIDA, a framework that adds epistemic structure to organizational AI knowledge, improving its ability to distinguish facts from unknowns.

Key contributions

  • Introduces OIDA, a framework for structuring organizational AI knowledge with epistemic classes.
  • Develops a Knowledge Gravity Engine for deterministic score maintenance with convergence guarantees.
  • Presents QUESTION-as-modeled-ignorance, a novel primitive to surface organizational unknowns.
  • Proposes the Epistemic Quality Score (EQS) for evaluating epistemic fidelity in AI systems.

Why it matters

This paper addresses a critical limitation in organizational AI: the lack of epistemic structure in knowledge retrieval. By introducing OIDA, it enables AI systems to differentiate between facts, hypotheses, and unknowns. This is crucial for building more reliable and context-aware AI agents, improving organizational decision-making.

Original Abstract

Organizational knowledge used by AI agents typically lacks epistemic structure: retrieval systems surface semantically relevant content without distinguishing binding decisions from abandoned hypotheses, contested claims from settled ones, or known facts from unresolved questions. We argue that the ceiling on organizational AI is not retrieval fidelity but \emph{epistemic} fidelity--the system's ability to represent commitment strength, contradiction status, and organizational ignorance as computable properties. We present OIDA, a framework that structures organizational knowledge as typed Knowledge Objects carrying epistemic class, importance scores with class-specific decay, and signed contradiction edges. The Knowledge Gravity Engine maintains scores deterministically with proved convergence guarantees (sufficient condition: max degree $< 7$; empirically robust to degree 43). OIDA introduces QUESTION-as-modeled-ignorance: a primitive with inverse decay that surfaces what an organization does \emph{not} know with increasing urgency--a mechanism absent from all surveyed systems. We describe the Epistemic Quality Score (EQS), a five-component evaluation methodology with explicit circularity analysis. In a controlled comparison ($n{=}10$ response pairs), OIDA's RAG condition (3,868 tokens) achieves EQS 0.530 vs.\ 0.848 for a full-context baseline (108,687 tokens); the $28.1\times$ token budget difference is the primary confound. The QUESTION mechanism is statistically validated (Fisher $p{=}0.0325$, OR$=21.0$). The formal properties are established; the decisive ablation at equal token budget (E4) is pre-registered and not yet run.

📬 Weekly AI Paper Digest

Get the top 10 AI/ML arXiv papers from the week — summarized, scored, and delivered to your inbox every Monday.