The Pause-Augmented for Disfluency Markers framework was developed, a novel preprocessing approach that explicitly encodes speech disfluencies as special tokens, preserving them for consumption by the classifiers.
Abstract
Recent advances in Natural Language Processing (NLP) have enabled new approaches for assessing cognitive health through speech analysis. Dementia remains a growing public health concern, yet diagnosis often relies on costly and time-consuming clinical assessments. Speechbased screening offers an alternative, as language deterioration is among the earliest signs of cognitive decline. However, most existing methods fail to effectively capture both how something is said (from the audio) and what is said (from the transcribed text). Yet both components are critical for accurate and reliable diagnosis. Therefore, this work explores independent approaches to evaluate the best-performing methods. Through systematic experimentation, it was found that standard NLP preprocessing pipelines remove clinically relevant disfluency patterns from speech transcripts before modelling, discarding features that may distinguish dementia from healthy speech. To address this, the Pause-Augmented for Disfluency Markers framework was developed, a novel preprocessing approach that explicitly encodes speech disfluencies as special tokens, preserving them for consumption by the classifiers.
Dementia is a major and growing public health concern that affects millions of individuals worldwide. Early detection has moved from traditional diagnostic methods to the use of predictive modeling approaches, Machine Learning (ML) and subsequently Deep Learning (DL) and more recently transformer-based models. The use...
The increasing number of affected people with neurodegenerative disorders, like Alzheimer’s disease, has made an urgent demand for cost-effective and accessible screening methods [1] . The Current gold standard diagnostic methods are considered impractical for widespread population screening due to their high costs, in...
Pooyan Mobtahej, Sarvenaz Ghaedi, Jacob Thomas et al.· IEEE/ACM International Confe...· 0 citations
The findings demonstrate that a leakage-safe evaluation protocol is essential for producing credible results in mental health classification from long social media posts and show that domain-informed density extraction provides a robust and practical text representation, with its greatest benefits emerging when models...
Rafat Hammad, Suha Rababah· Frontiers in Artificial Inte...· 0 citations
This work analyzed brief story retellings from 86 patients with left-hemisphere stroke and derived discrete linguistic features and embeddings with Large Language Models, providing proof of concept for a fast, largely automated discourse screener of acute LI.
LLM-Anchored Paralinguistic Enrichment is proposed, which enriches LLM-derived linguistic representations with paralinguistic cues through three coordinated innovations that achieves state-of-the-art performance across all four primary settings.
Xiao Wei, Yuqin Lin, Ya-Ru Cao et al.· 0 citations
This work systematically evaluates edge-oriented ASR-LLM pipelines for individuals with language impairments using comparison studies and ablation experiments across aphasia, child language impairment, and dementia datasets to identify transcript errors, repetition, noise, and input length as factors affecting system p...