Skip to content
Book Open access

Intent-Aware Backchanneling for Active Listening in Human-Robot Interaction

Aug 2026 · Message Understanding Conference · pp. 617-622 · 0 citations · 22 references
Computer Science

TL;DR

A ready-to-deploy intent-aware system in which a social robot conveys active listening through non-verbal backchannels grounded in interactional intents to enable active listening for robots.

Abstract

In conversational Human-Robot Interaction, robots typically remain silent during user speech and reply only after a pause, making interaction feel unnatural. In contrast, humans signal that they listen through active behavior. To overcome this, we present a system in which a social robot conveys active listening through non-verbal backchannels grounded in interactional intents. The system combines two ideas: (i) a dual-stage framework separating the user’s communicative intent (Speaker Intent) from the robot’s interactional stance (Listener Intent), mapping the latter to non-verbal reactions; and (ii) a parallel pipeline whose chunk-level branch generates non-verbal feedback during speech while a turn-level branch produces the verbal reply at turn end. We deployed this system on a robot and conducted a usability study (N = 6) in a hotel-negotiation task. We found that participants considered the system usable and could interpret gestures. We contribute a ready-to-deploy intent-aware system to enable active listening for robots.

Read PDF

Similar papers

Open access Sep 2026

Affect-aware conversational adaptation in mixed reality procedural tasks

A mixed-reality conversational system that integrates voice interaction, LLM-driven dialogue, and prosody-based affect-aware adaptation with a modular client–server architecture is presented, enabling emotion-related cues inferred from vocal prosody to be incorporated without interrupting conversational flow.

Andrea Antonio Cantone, Matteo Ercolino, M. Sebillo et al. · 0 citations
Preprint Sep 2026

MIRA: Real-Time Full-Duplex Human-Robot Interaction for Embodied Companions

This work presents MIRA, a unified framework for real-time full-duplex embodied companion interaction, and designs CORTEX, a dual-timescale interaction policy that combines low-latency barge-in preemption and streaming response generation with deliberative turn decisions, backed by a robot-side execution layer that enf...

Li-Jian Lin, Ye Zhu, Fan Zhang et al. · 0 citations
Review Sep 2026

EmoPose: Vision-Language Model Guided Emotion-Aware Gesture Generation for Humanoid Robots

Socially competent humanoid robots must communicate affect and intent through gesture as well as speech, yet open-ended interaction must become motion that is both expressive and executable on a specific body. This demands semantic flexibility for contextual social intent while preserving deterministic, embodiment-awar...

Dao-Jie Peng, Bing-Tao Wang, Fu-Long Ma et al. · 0 citations
Preprint Sep 2026

Multimodal Voice Activity Projection for Social Robot Mediation: Expected Behavior and Deployment Constraints

Turn-taking prediction is especially relevant for social robots that act as mediators in human-human interaction, where the expected action is often not to speak, but to orient, wait, avoid interruption, or prepare a balanced intervention. This paper presents Multimodal Voice Activity Projection (MM-VAP) as a human sta...

Antonio Cano, Guillermo Pérez, Luis Merino et al. · 0 citations
2025

Sound-Driven Turn-Taking in Robot-Assisted Quizzes: How Non-Verbal Buzzing Boosts and Challenges Motivation

Both the motivational potential and the emotional risks of competitive, sound-based interaction in educational human–robot interaction are demonstrated and technical reliability and transparent feedback are highlighted, highlighting that technical reliability and transparent feedback are not merely engineering concerns...

R. Tutul, I. Buchem · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.