ProMax: Exploring the Potential of LLM-derived Profiles with Distribution Shaping for Recommender Systems
Yi Zhang, Yiwen Zhang, Kai Zheng, Tong Chen, Hongzhi Yin
TLDR
ProMax uses LLM-derived profiles and distribution shaping to significantly improve recommender systems by guiding models to learn unseen item preferences.
Key contributions
- Proposes ProMax, a novel framework using LLM-derived profiles and distribution shaping for recommender systems.
- Employs dense retrieval to uncover collaborative relationships between user and item profiles in feature space.
- Introduces a dual distribution-reshaping process to guide recommendation models toward unseen item preferences.
- Substantially improves base model performance and outperforms existing LLM-based methods on multiple datasets.
Why it matters
ProMax offers a novel way to leverage LLM-derived user profiles for recommender systems. It addresses semantic loss issues of previous methods by using distribution shaping to guide models. This significantly enhances existing recommendation models, providing a more robust and effective integration of LLM insights for improved user experience.
Original Abstract
The remarkable text understanding and generation capabilities of large language models (LLMs) have revitalized the field of general recommendation based on implicit user feedback. Rather than deploying LLMs directly as recommendation models, a more flexible paradigm leverages their ability to interpret users' historical interactions and semantic contexts to extract structured profiles that characterize user preferences. These profiles can be further transformed into actionable high-dimensional representations, serving as powerful signals to augment and strengthen recommendation models. However, the mechanism by which such profiles enhance recommendation performance within the feature space remains insufficiently understood. Moreover, existing studies predominantly rely on nonlinear alignment and fusion strategies to incorporate these profiles, which often lead to semantic loss and fail to fully exploit their potential. To address these limitations, we revisit profiles from a retrieval perspective and propose a simple yet effective recommendation framework built upon distribution shaping (ProMax) in this paper. We begin by employing dense retrieval to uncover the collaborative relationships between user and item profiles within the feature space. Based on this insight, we introduce a dual distribution-reshaping process, in which the profile distribution acts as a guiding signal to steer the recommendation model toward learning user preferences for unseen items beyond the scope of observed interactions. We apply ProMax to four classic recommendation methods on three public datasets. The results indicate that ProMax substantially improves base model performance and outperforms existing LLM-based recommendation approaches.
📬 Weekly AI Paper Digest
Get the top 10 AI/ML arXiv papers from the week — summarized, scored, and delivered to your inbox every Monday.