MicroDiffuse3D: A Foundation Model for 3D Microscopy Imaging Restoration
Yongkang Li, Brian Wong, King Wai Chiu, Hanwen Xu, Tangqi Fang + 3 more
TLDR
MicroDiffuse3D is a foundation model that restores high-quality 3D microscopy images from degraded, low-resolution data, enabling faster volumetric chemical imaging.
Key contributions
- Introduces MicroDiffuse3D, a pretrained foundation model for 3D microscopy image restoration.
- Recovers high-quality 3D structures from degraded, low-resolution measurements at higher throughput.
- Evaluated across 3 settings: 3D super-resolution (16x sparsity), resolution/noise degradation, and 3D denoising.
- Improved segmentation quality by 10.58% and line-profile concordance by 15.59% in super-resolution.
Why it matters
Slow 3D chemical imaging limits its use in diagnostics and drug analysis. MicroDiffuse3D overcomes these throughput and SNR limitations, enabling high-resolution volumetric analysis at unprecedented speeds. This advances chemical imaging for broader applications.
Original Abstract
Chemical imaging enables label-free visualization of cells, tissues and living systems while providing direct biochemical information that is difficult to obtain with conventional fluorescence microscopy. Despite its promise in applications ranging from intraoperative diagnosis to drug-response analysis, its broader use remains limited by slow data acquisition, particularly for three-dimensional imaging. Here we present MicroDiffuse3D, a pretrained foundation model for 3D microscopy image restoration that recovers high-quality volumetric structure from degraded low-resolution measurements acquired at substantially higher throughput. We evaluated MicroDiffuse3D across three challenging restoration settings, including 3D super-resolution under 16-fold volumetric sparsity, joint degradation in resolution and noise, and 3D denoising in the low signal-to-noise ratio (SNR) regime, where the model delivered clear gains over strong baselines. Under the sparse 3D super-resolution setting, MicroDiffuse3D produced clearer continuity across depth with fewer artifacts and improved segmentation quality by 10.58% and line-profile concordance by 15.59%. Together, our results establish pretrained 3D restoration as a broadly applicable strategy for overcoming the throughput and SNR limitations in volumetric chemical imaging, enabling high-resolution analysis at scales and speeds that were previously difficult to achieve.
📬 Weekly AI Paper Digest
Get the top 10 AI/ML arXiv papers from the week — summarized, scored, and delivered to your inbox every Monday.