Skip to content
Open access

A Prompt-Guided and Quality-Aware Robust Text–Audio Intent Recognition Framework for Elderly Care

Aug 2026 · Italian National Conference on Sensors · Vol 26 · 0 citations · 31 references
Medicine

TL;DR

A prompt-guided and quality-aware text–audio intent recognition framework that can improve the robustness of intent recognition under challenging acoustic conditions in elderly-oriented interaction scenarios is proposed.

Abstract

In natural language understanding, intent recognition plays a central role in human–computer interaction. However, in elderly-care scenarios, acoustic signals are often affected by atypical speech patterns, slower speaking rates, and environmental noise, making audio information less reliable and reducing the effectiveness of conventional text–audio fusion methods. To address this problem, we propose a prompt-guided and quality-aware text–audio intent recognition framework. Specifically, a χ2-based intent prototype soft prompt is introduced to enhance the semantic representation of text. Then, a residual-free text-guided cross-attention module is designed to refine degraded acoustic features using textual semantics as reliable guidance. In addition, a dynamic fusion gate is developed to adjust the contributions of text and audio based on modality reliability and intent-related information. Experiments on the MIntRec dataset with simulated acoustic degradation show that the proposed model achieves 60.90% accuracy, 60.80% weighted F1, and 57.90% macro-F1, outperforming several competitive baselines. These results indicate that the proposed framework can improve the robustness of intent recognition under challenging acoustic conditions in elderly-oriented interaction scenarios.

Read PDF

Similar papers

Open access Aug 2026

Application of Conformer Architecture in Clinical Speech Input and Intelligent Medical Record Generation

This study proposes a multi-stage intelligent documentation framework that integrates a 12-layer Conformer architecture, BERT-BiLSTM-CRF semantic modeling, and BART-based structured text generation that illustrates the effectiveness of deep time-frequency feature extraction and contextual sequence modeling for complex...

Xian-Kun Zou, L. Wang, J. Sun et al. · 0 citations
Open access Aug 2026

Semantic-aligned multimodal human activity recognition using visual and audio data

Results indicate that semantic-aligned score-level fusion can improve recognition robustness even under mismatched dataset conditions, and show that semantic-aligned score-level fusion can improve recognition robustness even under mismatched dataset conditions.

Yeeun Park, Joonho Byun, Siwoo Byun · 0 citations
Open access Aug 2026

Edge AI-Based Object Detection via Voice Recognition with an LLM-Based Emotional Assistant for Elderly Care Robots

This paper presents a fully integrated, real-time assistive system that combines voice-based object recognition with a generative conversational interface, specifically designed to enhance elderly care through edge AI deployment, and adopts a hybrid edge architecture.

Sarra Ben Halima, Faten Ben Abdallah, Joseph Haggège · 0 citations
Review Jul 2026

Advancing emotion recognition: a novel adaptive audio–visual fusion approach

This work starts with a concise review of the field, emphasizing key steps for accurate emotion recognition, including feature extraction from both speech and facial modalities and classification using both traditional machine learning and modern deep learning techniques.

Hadhami Aouani, Y. Ben Ayed · 0 citations
Open access Aug 2026

Adaptive Reliability-Guided Multimodal Learning Framework for Robust Emotion and Sentiment Classification Under Noisy and Missing Modalities

The Adaptive Reliability-Guided Multimodal Artificial Intelligence system outperforms existing state-of-the-art multimodal learning algorithms under noisy and missing modality situations and provides consistent convergence and enhanced generalisation for real-world affective computing applications.

S. V · 0 citations
Jul 2026

Toward Generalizable Cognitive Impairment Detection with Speech-Based Multimodal Large Language Models

This work establishes a new state-of-the-art for CI identification, with the proposed method demonstrating superior cross-dataset generalization and the power of an LLM-based multimodal framework that fuses linguistic and acoustic data to enable robust, scalable, and non-invasive screening.

Ying-lei Huang, Xin Wang, Yuhan Su et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.