AIFIND: Artifact-Aware Interpreting Fine-Grained Alignment for Incremental Face Forgery Detection
Hao Wang, Beichen Zhang, Yanpei Gong, Shaoyi Fang, Zhaobo Qi + 3 more
TLDR
AIFIND introduces artifact-aware semantic anchors and attention to stabilize incremental face forgery detection, preventing feature drift and catastrophic forgetting.
Key contributions
- Proposes AIFIND, an incremental face forgery detection method using semantic anchors to stabilize learning.
- Uses an Artifact-Driven Semantic Prior Generator to create invariant semantic anchors from low-level artifact cues.
- Employs Artifact-Probe Attention to align visual features with stable semantic anchors, reducing feature volatility.
- Introduces an Adaptive Decision Harmonizer to maintain geometric consistency across tasks using semantic anchors.
Why it matters
Incremental face forgery detection struggles with feature drift and catastrophic forgetting. AIFIND's artifact-aware semantic anchors offer a robust solution for continuous learning, ensuring reliable and adaptable detection of new forgery types.
Original Abstract
As forgery types continue to emerge consistently, Incremental Face Forgery Detection (IFFD) has become a crucial paradigm. However, existing methods typically rely on data replay or coarse binary supervision, which fails to explicitly constrain the feature space, leading to severe feature drift and catastrophic forgetting. To address this, we propose AIFIND, Artifact-Aware Interpreting Fine-Grained Alignment for Incremental Face Forgery Detection, which leverages semantic anchors to stabilize incremental learning. We design the Artifact-Driven Semantic Prior Generator to instantiate invariant semantic anchors, establishing a fixed coordinate system from low-level artifact cues. These anchors are injected into the image encoder via Artifact-Probe Attention, which explicitly constrains volatile visual features to align with stable semantic anchors. Adaptive Decision Harmonizer harmonizes the classifiers by preserving angular relationships of semantic anchors, maintaining geometric consistency across tasks. Extensive experiments on multiple incremental protocols validate the superiority of AIFIND.
📬 Weekly AI Paper Digest
Get the top 10 AI/ML arXiv papers from the week — summarized, scored, and delivered to your inbox every Monday.