Agentic Microphysics: A Manifesto for Generative AI Safety
Federico Pierucci, Matteo Prandi, Marcantonio Bracale Syrnikov, Marcello Galisai, Piercosma Bisconti
TLDR
This paper proposes "Agentic Microphysics" and "Generative Safety" to analyze and mitigate population-level risks in interacting agentic AI systems.
Key contributions
- Introduces "Agentic Microphysics" to analyze local interaction dynamics in agentic AI systems.
- Proposes "Generative Safety" as a methodology to identify and intervene on emergent risks.
- Addresses the methodological gap in current AI safety for population-level risks from agent interaction.
Why it matters
As AI systems become more agentic and interactive, traditional safety analysis falls short. This paper provides a crucial framework to understand and control emergent risks arising from collective agent behavior, moving beyond isolated model analysis. It offers a path to design safer multi-agent AI.
Original Abstract
This paper advances a methodological proposal for safety research in agentic AI. As systems acquire planning, memory, tool use, persistent identity, and sustained interaction, safety can no longer be analysed primarily at the level of the isolated model. Population-level risks arise from structured interaction among agents, through processes of communication, observation, and mutual influence that shape collective behaviour over time. As the object of analysis shifts, a methodological gap emerges. Approaches focused either on single agents or on aggregate outcomes do not identify the interaction-level mechanisms that generate collective risks or the design variables that control them. A framework is required that links local interaction structure to population-level dynamics in a causally explicit way, allowing both explanation and intervention. We introduce two linked concepts. Agentic microphysics defines the level of analysis: local interaction dynamics where one agent's output becomes another's input under specific protocol conditions. Generative safety defines the methodology: growing phenomena and elicit risks from micro-level conditions to identify sufficient mechanisms, detect thresholds, and design effective interventions.
📬 Weekly AI Paper Digest
Get the top 10 AI/ML arXiv papers from the week — summarized, scored, and delivered to your inbox every Monday.