ArXiv TLDR

DPN-LE: Dual Personality Neuron Localization and Editing for Large Language Models

🐦 Tweet
2604.27929

Lifan Zheng, Xue Yang, Jiawei Chen, Chenyan Wu, Jingyuan Zhang + 4 more

cs.CL

TLDR

DPN-LE precisely edits personality in LLMs by targeting specific, mutually exclusive neurons, preserving general capabilities better than prior methods.

Key contributions

  • Existing LLM personality editing methods degrade performance by modifying too many neurons.
  • DPN-LE identifies personality-specific neurons using contrastive MLP activations and dual-criterion filtering.
  • It intervenes on only ~0.5% of neurons for precise, inference-time personality control.
  • Achieves competitive personality control with significantly better capability preservation.

Why it matters

This paper tackles the critical issue of maintaining LLM general capabilities during personality editing. DPN-LE's precise, sparse intervention offers a more efficient and less disruptive approach. This is vital for creating customizable and robust LLMs without compromising their core reasoning abilities.

Original Abstract

With the widespread adoption of large language models (LLMs), understanding their personality representation mechanisms has become critical. As a novel paradigm in Personality Editing, most existing methods employ neuron-editing to locate and modify LLM neurons, requiring changes to numerous neurons and leading to significant performance degradation. This raises a fundamental question: Are all modified neurons directly related to personality representation? In this work, we investigate and quantify this specificity through assessments of general capability impact and representation-level patterns. We find that: 1) Current methods can change personalities but reduce overall performance. 2) Neurons are multifunctional, connecting personality traits and general knowledge. 3) Opposing personality traits demonstrate distinctly mutually exclusive representation patterns. Motivated by these findings, we propose DPN-LE (Dual Personality Neuron Localization and Editing), which identifies personality-specific neurons by contrasting MLP activations between high-trait and low-trait samples. DPN-LE constructs layer-wise steering vectors and applies dual-criterion filtering based on Cohen's $d$ effect size and activation magnitude to isolate mutually exclusive neuron subsets. Sparse linear intervention on these neurons enables precise personality control at inference time. Using only 1,000 contrastive sample pairs per trait, DPN-LE intervenes on $\sim$0.5\% of neurons while achieving competitive personality control and substantially better capability preservation across reasoning tasks. Experiments on LLaMA-3-8B-Instruct and Qwen2.5-7B-Instruct demonstrate the effectiveness and generalizability of our approach.

📬 Weekly AI Paper Digest

Get the top 10 AI/ML arXiv papers from the week — summarized, scored, and delivered to your inbox every Monday.