Skip to content
Review Open access

PersonaKit (PK): A Plug-and-Play Platform for User Testing Diverse Roles in Simulated Full-Duplex Dialogue

2026 · SIGDIAL Conferences · pp. 597-601 · 0 citations · 8 references
Computer Science

TL;DR

This work presents PersonaKit (PK), an open-source, low-latency web platform that simulates full-duplex turn-taking pragmatics—via a cascade pipeline and prompt-level control rather than a jointly trained speak-while-listening model.

Abstract

As spoken dialogue systems take on diverse personas—authoritative instructors, uncoop-erative merchants, distracted workers—they need distinct, human-like turn-taking to stay immersive. Yet current full-duplex systems default to a rigid “always-yield” policy during overlap, undermining character consistency for non-submissive roles, and evaluating persona-specific alternatives through user studies demands substantial real-time engineering. We present PersonaKit (PK), an open-source, low-latency web platform that simulates full-duplex turn-taking pragmatics—via a cascade pipeline and prompt-level control rather than a jointly trained speak-while-listening model. Through intuitive JSON configurations, researchers define personas, specify probabilistic interruption handling (yield, hold, bridge, override), and auto-deploy comparative A/B surveys. An in-the-wild evaluation with 8 personas shows that PK is an extensible, end-to-end framework for studying complex sociolinguistic behaviors in next-generation spoken agents.

Read PDF

Similar papers

#artificial intelligence Preprint Sep 2026

OSPD: On-Policy Self-Distillation for Persona-Consistent Dialogue

This work proposes OSPD, an on-policy self-distillation framework where the same model serves as both teacher and student under asymmetric information: the teacher receives a complete character profile while the student sees only a brief summary, and the student generates trajectories from its own policy.

Rui Xu, Yikai Zhang, Ai-Li Chen et al. · 0 citations
#natural language process... Preprint Oct 2026

Conversation Is a Two-Body Problem: Dyadic Evaluation of Full-Duplex Dialogue Models

Full-duplex spoken dialogue models listen and speak at the same time, enabling voice agents to have natural, low-latency interactions that turn-based systems cannot offer. However, they are commonly evaluated against single-sided interlocutors: pre-recorded audio that cannot react, or an automated examiner that reacts...

Sungnyun Kim, Sungwoo Cho, Ji-Yun Oh et al. · 0 citations
#natural language process... Preprint Aug 2026

TurnBench: A Multi-Domain Benchmark for Turn-Taking Dynamics in Spoken Dialogue

TurnBench, a multi-domain benchmark that pairs a 30-hour, hand-labeled corpus of dyadic human conversation with a standardized evaluation protocol for end-of-turn and interruption detection, finds end-of-turn recall stable across types, while interruption false positives are strongly type-dependent and concentrated in...

Freeman Jiang, Ramon Sanabria, Soham Deshmukh et al. · 7 citations · ⚡2
#artificial intelligence Preprint Sep 2026

Qwen-Audio-3.1-Realtime: Towards Reliable Agentic Voice Interaction

Real-time voice assistants must reason over evolving requests, execute actions, and follow conversational rules. Qwen-Audio-3.1-Realtime brings these requirements together through Think, Act, and Speak and Coordinate. Think combines Core-Cocktail supervised fine-tuning with Multimodality and Multi-Teacher On-Policy Dis...

Lu-Jia Bao, Qian Chen, Luyao Cheng et al. · 1 citation
#artificial intelligence Preprint Oct 2026

Coupled but Late: Turn-Taking Between Full-Duplex Speech Models in Unscripted Dialogue

Full-duplex speech models are trained to converse with a person, but they are increasingly made to converse with each other, in self-play data generation, agent societies, and model-based evaluation. In that loop no human absorbs a timing error: each model's turn-taking is the other's input. We ask what timing the loop...

Li-Chen Zhu, Yueqian Lin, Yi-Heng Wang et al. · 0 citations
Preprint Sep 2026

RePlay: Retrieval-Based Voice Playback for Multi-Turn spoken dialogue

Many voice interaction applications require exact control over both the content and delivery of responses, typically using pre-recorded lines. Recent full-duplex models respond with low latency but cannot guarantee exact content or reproduce a specific recorded performance, while cascaded systems can be constrained to...

Sathvik Udupa, Naveen Kumar, Ryan Folmsbee · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.