Beyond Text Prompts: Precise Concept Erasure through Text-Image Collaboration
Jun Li, Lizhi Xiong, Ziqiang Li, Weiwei Jiang, Zhangjie Fu + 2 more
TLDR
TICoE is a text-image collaborative framework that precisely erases undesirable concepts from generative models while preserving content fidelity.
Key contributions
- Introduces TICoE, a text-image collaborative framework for precise concept erasure.
- Utilizes a continuous convex concept manifold and hierarchical visual representation learning.
- Achieves precise removal of target concepts while preserving unrelated semantic and visual content.
- Proposes a fidelity-oriented evaluation strategy to assess post-erasure usability.
Why it matters
Generative models can inadvertently produce unsafe content due to biases. Existing erasure methods are often imprecise, either failing to fully suppress or over-erasing. TICoE offers a more precise and faithful solution, leading to safer and more controllable text-to-image generation.
Original Abstract
Text-to-image generative models have achieved impressive fidelity and diversity, but can inadvertently produce unsafe or undesirable content due to implicit biases embedded in large-scale training datasets. Existing concept erasure methods, whether text-only or image-assisted, face trade-offs: textual approaches often fail to fully suppress concepts, while naive image-guided methods risk over-erasing unrelated content. We propose TICoE, a text-image Collaborative Erasing framework that achieves precise and faithful concept removal through a continuous convex concept manifold and hierarchical visual representation learning. TICoE precisely removes target concepts while preserving unrelated semantic and visual content. To objectively assess the quality of erasure, we further introduce a fidelity-oriented evaluation strategy that measures post-erasure usability. Experiments on multiple benchmarks show that TICoE surpasses prior methods in concept removal precision and content fidelity, enabling safer, more controllable text-to-image generation. Our code is available at https://github.com/OpenAscent-L/TICoE.git
📬 Weekly AI Paper Digest
Get the top 10 AI/ML arXiv papers from the week — summarized, scored, and delivered to your inbox every Monday.