Reduced-Precision Stochastic Simulation for Mathematical Biology
Tom Kimpson, Mark B. Flegg, Jennifer A. Flegg
TLDR
Reduced-precision stochastic simulation (SSA) with mixed precision and stochastic rounding accelerates biological simulations without losing accuracy.
Key contributions
- Mixed-precision SSA (16-bit propensities) matches 64-bit reference statistics across 5 models.
- Uniform 16-bit precision requires stochastic rounding (SR) and normalization to maintain statistical fidelity.
- Reduced-precision SSA offers up to 1.5x speedup and 2-4x memory reduction on CPU hardware.
- Complements existing algorithms and maps naturally onto modern GPU and TPU architectures.
Why it matters
Stochastic simulation (SSA) is vital for biological modeling but computationally intensive. This paper introduces reduced-precision SSA, with mixed precision and stochastic rounding, to accelerate simulations and enable larger-scale biological modeling.
Original Abstract
The stochastic simulation algorithm (SSA) is widely used to perform exact forward simulation of discrete stochastic processes in biology. However, the computational cost, driven by sequential event-by-event sampling across large ensembles, remains a computational barrier. We investigate whether reduced-precision floating-point arithmetic can accelerate SSA without degrading statistical fidelity, drawing on the success of reduced-precision methods in weather and climate modelling. We evaluate two strategies across five canonical models (birth--death, Schlögl, Telegraph, dimerisation, repressilator): (i) mixed precision, computing propensities in 16-bit while maintaining accumulators in 32-bit; and (ii) uniform precision, performing all arithmetic in 16-bit. Mixed-precision SSA produces ensemble statistics that closely match the 64-bit reference for all models, as measured by Kolmogorov--Smirnov tests and Wasserstein distances. Under uniform precision, deterministic rounding introduces systematic biases across several models, with catastrophic failures in some cases. Stochastic rounding (SR) and propensity normalisation eliminate these biases, restoring distributional fidelity across all models tested (KS $p > 0.05$). Our results establish mixed-precision SSA with SR as a viable acceleration strategy for mathematical biology: 16-bit formats shrink per-variable data size by $2$--$4\times$ relative to \texttt{fp32}/\texttt{fp64}, yielding comparable reductions in memory footprint and up to $\sim 1.5\times$ wall-clock speedup on CPU hardware that lacks native 16-bit arithmetic. As a hardware-level acceleration, mixed-precision SSA complements algorithmic methods such as tau-leaping and maps naturally onto modern GPU and TPU architectures with native 16-bit arithmetic.
📬 Weekly AI Paper Digest
Get the top 10 AI/ML arXiv papers from the week — summarized, scored, and delivered to your inbox every Monday.