Structure as Computation: Developmental Generation of Minimal Neural Circuits
TLDR
Simulating neurogenesis with gene rules creates minimal neural circuits that achieve rapid learning on MNIST and CIFAR-10.
Key contributions
- Simulates cortical neurogenesis from a single stem cell using mouse gene regulatory rules.
- Generates a minimal circuit of 85 densely connected neurons from 5,000 simulated cells.
- Achieves over 90% accuracy on MNIST after a single epoch of standard training.
- Demonstrates domain-general rapid learning, achieving 40.53% on CIFAR-10 after one epoch.
Why it matters
This research suggests that biological developmental processes inherently encode powerful structural priors. These priors create neural architectures exceptionally amenable to rapid learning, offering insights into efficient AI design.
Original Abstract
This work simulates the developmental process of cortical neurogenesis, initiating from a single stem cell and governed by gene regulatory rules derived from mouse single-cell transcriptomic data. The developmental process spontaneously generates a heterogeneous population of 5,000 cells, yet yields only 85 mature neurons - merely 1.7% of the total population. These 85 neurons form a densely interconnected core of 200,400 synapses, corresponding to an average degree of 4,715 per neuron. At iteration zero, this minimal circuit performs at chance level on MNIST. However, after a single epoch of standard training, accuracy surges to over 90% - a gain exceeding 80 percentage points - with typical runs falling in the 89-94% range depending on developmental stochasticity. The identical circuit, without any architectural modification or data augmentation, achieves 40.53% on CIFAR-10 after one epoch. These findings demonstrate that developmental rules sculpt a domain-general topological substrate exceptionally amenable to rapid learning, suggesting that biological developmental processes inherently encode powerful structural priors for efficient computation.
📬 Weekly AI Paper Digest
Get the top 10 AI/ML arXiv papers from the week — summarized, scored, and delivered to your inbox every Monday.