ArXiv TLDR

PersonaKit (PK): A Plug-and-Play Platform for User Testing Diverse Roles in Full-Duplex Dialogue

🐦 Tweet
2605.06007

Hyunbae Jeon, Jinho D. Choi

cs.CLcs.AIcs.HC

TLDR

PersonaKit is an open-source platform for rapidly prototyping and evaluating diverse persona-specific turn-taking strategies in full-duplex dialogue systems.

Key contributions

  • Enables rapid prototyping and evaluation of conversational agents with diverse personas.
  • Allows defining personas and probabilistic interruption behaviors via intuitive JSON configurations.
  • Automates deployment of comparative A/B user surveys for turn-taking strategies.
  • Supports studying complex sociolinguistic behaviors in next-generation spoken agents.

Why it matters

Current full-duplex dialogue systems struggle with diverse personas due to rigid turn-taking. PersonaKit provides an accessible solution, simplifying the design and testing of human-like interaction behaviors. This advances the development of more immersive and versatile conversational AI.

Original Abstract

As spoken dialogue systems expand beyond traditional assistant roles to encompass diverse personas -- such as authoritative instructors, uncooperative merchants, or distracted workers -- they require distinct, human-like turn-taking behaviors to maintain psychological immersion. However, current full-duplex systems often default to a rigid, overly accommodating ``always-yield'' policy during overlapping speech, which severely undermines character consistency for non-submissive roles. Evaluating alternative, persona-specific turn-taking strategies through empirical user studies is challenging because building real-time full-duplex test environments requires substantial engineering overhead. To address this, we present PersonaKit (PK), an open-source, low-latency web platform for the rapid prototyping and evaluation of conversational agents. Using intuitive JSON configurations, researchers can define personas, specify probabilistic interruption-handling behaviors (e.g., yield, hold, bridge, or override), and automatically deploy comparative A/B surveys. Through an in-the-wild evaluation with 8 distinct personas, we demonstrate that PersonaKit provides an extensible, end-to-end framework for studying complex sociolinguistic behaviors in next-generation spoken agents.

📬 Weekly AI Paper Digest

Get the top 10 AI/ML arXiv papers from the week — summarized, scored, and delivered to your inbox every Monday.