K. Inoue

Improving Empathetic Response Generation with Retrieval based on Emotion Recognition

Constructing a Multi-Party Conversational Corpus Focusing on Interlocutor Relationships

CultureConverse: A Multilingual Multi-turn Simulation Harness for Culturally Grounded Assistance in East and Southeast Asia

CultureConverse is introduced, a scalable, multilingual simulation and evaluation harness for culturally grounded assistant dialogue that covers 10 East and Southeast Asian regions, 58 subgroup identities, and 7 domains and performance gains from fine-tuning on 27,860 high-quality CultureConverse-DS samples improve in-...

Multimodal Temporal Modeling for Continuous Group Emotion Recognition in Multi-party Dialogues

This study forms continuous recognition of the Group Emotion at a one-second resolution, introduces the Mixed state, which captures the emotional divergence among participants in the group, and proposes a multimodal temporal framework that integrates audio and video information using a sliding-window context.

MemUse: Moving Memory Evaluation from Direct QA to Natural Integration in Long-Term Human-AI Conversation

It is hypothesize that existing benchmarks and user satisfaction are tracking different capabilities: benchmarks measure elicited retrieval (recall when asked), while conversation requires natural integration (detecting relevance and naturally weaving prior context into a response).

Low-Latency Turn-Taking via Context-Aware Preface Generation in a Real-World Dialogue Robot

Large language model (LLM)-based dialogue systems suffer response delays because generation begins only after final speech recognition. While fixed fillers are a workaround, they become unnatural over time. We propose a two-stage incremental framework that decouples prefatory-response preparation from speech onset. Onc...

Human-robot conversation with multiple participants in noisy public spaces

This work proposes an audio system that can be used for both an attentive listening system with the android ERICA and a conversation support system with mobile Teleco robots, with one of them acting as an avatar for a remote operator.

TEIDAN: A Multilingual Multiparty Dialogue Corpus

This paper describes the collection design, participants, recording setup, transcription format, and corpus statistics, and provides preliminary analyses to illustrate how TEIDAN can support research on turn-taking, addressee recognition, and multimodal grounding in human-human and human-agent interaction.

MMAC: A Multilingual, Multimodal Alignment Framework for Cultural Grounding Evaluation

The causes of modal divergence are probed, offering insights into fostering culturally robust MLLMs, and a Multilingual, Multimodal Alignment framework for Cultural grounding evaluation is proposed.

CultureConverse: A Multilingual Multi-turn Simulation Harness for Culturally Grounded Assistance in East and Southeast Asia

CultureConverse is introduced, a scalable, multilingual simulation and evaluation harness for culturally grounded assistant dialogue that covers 10 East and Southeast Asian regions, 58 subgroup identities, and 7 domains and performance gains from fine-tuning on 27,860 high-quality CultureConverse-DS samples improve in-...