ArXiv TLDR

AlbumFill: Album-Guided Reasoning and Retrieval for Personalized Image Completion

🐦 Tweet
2605.02892

Yu-Ju Tsai, Brian Price, Qing Liu, Luis Figueroa, Daniil Pakhomov + 3 more

cs.CVcs.IR

TLDR

AlbumFill is a training-free framework that retrieves identity-consistent references from personal albums for personalized image completion.

Key contributions

  • AlbumFill: A training-free framework for personalized image completion.
  • Uses a vision-language model to infer missing semantics and guide reference retrieval.
  • Retrieves identity-consistent images from personal albums to aid completion.
  • Introduces a new 54K human-centric dataset for personalized image completion.

Why it matters

Existing personalized image completion methods struggle with identity consistency. AlbumFill solves this by automatically retrieving identity-consistent references from personal albums, offering a practical, training-free solution. This work provides a valuable dataset, advancing realistic and user-friendly photo editing.

Original Abstract

Personalized image completion aims to restore occluded regions in personal photos while preserving identity and appearance. Existing methods either rely on generic inpainting models that often fail to maintain identity consistency, or assume that suitable reference images are explicitly provided. In practice, suitable references are often not explicitly provided, requiring the system to search for identity-consistent images within personal photo collections. We present AlbumFill, a training-free framework that retrieves identity-consistent references from personal albums for personalized completion. Given an occluded image and a personal album, a vision-language model infers missing semantic cues to guide composed image retrieval, and the retrieved references are used by reference-based completion models. To facilitate this task, we introduce a dataset containing 54K human-centric samples with associated album images. Experiments across multiple baselines demonstrate the difficulty of personalized completion and highlight the importance of identity-consistent reference retrieval. Project Page: https://liagm.github.io/AlbumFill/

📬 Weekly AI Paper Digest

Get the top 10 AI/ML arXiv papers from the week — summarized, scored, and delivered to your inbox every Monday.