Skip to content
Open access

Lightweight AI-Driven Real-Time Swahili Sign Language Recognition: A Way to Empower Hearing-Impaired Individuals

Aug 2026 · Indonesian Journal of Computer Science · 0 citations

TL;DR

An AI-driven real-time Swahili Sign Language Recognition system designed to bridge communication gaps between the hearing-impaired community and the general population and outperforming several existing models is proposed.

Abstract

Hearing impairment is a growing global health challenge that disproportionately affects people in resource-constrained countries such as Tanzania, where access to assistive technologies remains limited. Conventional solutions, including hearing aids, cochlear implants, and interpreters, are often costly and inaccessible. This study proposes an AI-driven real-time Swahili Sign Language Recognition system designed to bridge communication gaps between the hearing-impaired community and the general population. The system integrates Convolutional Neural Networks (CNNs), Scale-Invariant Feature Transform (SIFT), and Long Short-Term Memory (LSTM) with computer vision techniques to recognize and interpret sign gestures. SIFT extracts key features from images captured via webcam, while CNN performs classification and LSTM models temporal dependencies for improved accuracy. Experimental results reveals high recognition accuracy of 98.5% and a low error rate of 0.1345%, outperforming several existing models. The system offers an effective, affordable solution for enhancing communication among Swahili-speaking communities.

Read PDF

Similar papers

Dynamic Sign Language Recognition: A Hybrid Approach Combining MediaPipe and LSTM

This proposed research presents a real-time American Sign Language (ASL) recognition system for 24 dynamic signs that integrates the MediaPipe frame work with Long Short-Term Memory (LSTM) network to achieve efficient real-time dynamic sign recognition with reduced computational and data requirements.

Youssef Farhan, Zineb Haimer, Oumaima Lamaamar et al. · 0 citations
Aug 2026

SignAura: An AI-Based Real-Time Recognition System for Sri Lankan Sign Language

SignAura is introduced, an artificial intelligence-driven real-time SLSL sign-recognition system that provides multilingual lexical text and synthesized speech and performs isolated sign-level recognition and provides corresponding multilingual lexical output rather than complete grammatical sign-language translation.

Pramudhi Hansi Wijesinghe, Nimesh Pollwaththage, D. Dhammearatchi · 0 citations
Open access Sep 2026

Self-Attention-Based VGG16 Approach for Sign Language Gesture Recognition in Inclusive Education

A self-attention-based VGG16 framework for static sign language gesture recognition of alphabetic and numeric hand signs and suggests that the proposed framework can serve as a promising building block for intelligent assistive technologies supporting inclusive educational environments.

Naoufal El-Marzouki, Imane Lasri, Fatim Ezzahrae Dorhmi et al. · 0 citations
Conference Aug 2026

A Lightweight Hybrid 1D CNN and Bi GRU Architecture for Real Time Sign Language Recognition

An efficient process for recognizing sign languages plays an important role in reducing the communication barrier between hearing-impaired people and others. Nevertheless, most of the currently available sign language recognition processes fail to produce highly accurate results within a minimum time period. In this pa...

Sujal Chaudhari, Gandhar Chafle, Arjun Mankuskar et al. · 0 citations
Open access Sep 2026

A wearable glove-based system for real-time sign language recognition using parallel hybrid CNN–LSTM

Real time sign language recognition (SLR) is essential for bridging communication gaps for the hearing impaired; however, existing solutions often suffer from high hardware complexity, excessive weight, and processing latency. To address these limitations, this paper presents a lightweight, cost-effective wearable gest...

Muhammad Asim, Shan Zhou, Waga Arachchige Vishodha Charithani Waga Arachchi et al. · 0 citations
Open access 2026

A Real-Time Deep Learning-Based Sign Language Recognition System for Words, Alphabets, and Numbers

This paper presents a sign language recognition system based on deep learning and computer vision. It aims to support communication between deaf and hard-of-hearing individuals and the community. The proposed system translates hand gestures into textual output through real-time image and video processing. It supports t...

Milia Habib, Teddy Nohra, Charbel Srour et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.