Anomalies in Neural Network Field Theory
Christian Ferko, Samuel Frank, James Halverson, Vishnu Jejjala
TLDR
A new Neural Network Field Theory (NN-FT) framework is developed to analyze anomalies and symmetries across machine learning and physics.
Key contributions
- Establishes Neural Network Field Theory (NN-FT) with derived Schwinger-Dyson equations and Ward identities.
- Introduces a conserved parameter space current to characterize symmetries and their breaking in NN-FT.
- Applies NN-FT to study anomalies in ML (feedforward, attention) and diverse physics systems.
- Provides a new framework to understand quantum field theory symmetries via network parameter space.
Why it matters
This paper introduces a novel Neural Network Field Theory (NN-FT) framework, bridging neural networks with field theory. It offers a new way to understand symmetries and anomalies in both machine learning and quantum field theories, potentially yielding deeper insights.
Original Abstract
Neural network field theory (NN-FT) formulates field theory in terms of a network architecture and a density on its parameters. We derive Schwinger--Dyson equations and Ward identities in NN-FT and utilize them to study anomalies. The equations depend on a conserved parameter space current that characterizes symmetries and how they break. It is relevant even in non-local NN-FTs, but can recover local currents in the case of a local Lagrangian by an appropriate fiber-wise average. In machine learning, this formalism is applied to feedforward networks and the attention mechanism. In physics, we use this machinery to study $U(1)$ symmetry for a complex scalar, the scale anomaly in $4d$ massless $φ^4$ theory, the Weyl anomaly for the bosonic string (including a new computation of the critical dimension), and examples involving discrete topological data, such as winding numbers and T-duality. Since the results are obtained in network parameter space rather than the standard field space, they represent a new way to understand symmetries in quantum field theories.
📬 Weekly AI Paper Digest
Get the top 10 AI/ML arXiv papers from the week — summarized, scored, and delivered to your inbox every Monday.