PersonaKit (PK): A Plug-and-Play Platform for User Testing Diverse Roles in Full-Duplex Dialogue
TLDR
PersonaKit is an open-source platform for rapidly prototyping and evaluating diverse persona-specific turn-taking strategies in full-duplex dialogue systems.
Key contributions
- Enables rapid prototyping and evaluation of conversational agents with diverse personas.
- Allows defining personas and probabilistic interruption behaviors via intuitive JSON configurations.
- Automates deployment of comparative A/B user surveys for turn-taking strategies.
- Supports studying complex sociolinguistic behaviors in next-generation spoken agents.
Why it matters
Current full-duplex dialogue systems struggle with diverse personas due to rigid turn-taking. PersonaKit provides an accessible solution, simplifying the design and testing of human-like interaction behaviors. This advances the development of more immersive and versatile conversational AI.
Original Abstract
As spoken dialogue systems expand beyond traditional assistant roles to encompass diverse personas -- such as authoritative instructors, uncooperative merchants, or distracted workers -- they require distinct, human-like turn-taking behaviors to maintain psychological immersion. However, current full-duplex systems often default to a rigid, overly accommodating ``always-yield'' policy during overlapping speech, which severely undermines character consistency for non-submissive roles. Evaluating alternative, persona-specific turn-taking strategies through empirical user studies is challenging because building real-time full-duplex test environments requires substantial engineering overhead. To address this, we present PersonaKit (PK), an open-source, low-latency web platform for the rapid prototyping and evaluation of conversational agents. Using intuitive JSON configurations, researchers can define personas, specify probabilistic interruption-handling behaviors (e.g., yield, hold, bridge, or override), and automatically deploy comparative A/B surveys. Through an in-the-wild evaluation with 8 distinct personas, we demonstrate that PersonaKit provides an extensible, end-to-end framework for studying complex sociolinguistic behaviors in next-generation spoken agents.
📬 Weekly AI Paper Digest
Get the top 10 AI/ML arXiv papers from the week — summarized, scored, and delivered to your inbox every Monday.