Skip to content
Conference Open access

Robust Person Following in Crowds Using Complementary Cross-Modal Fusion

Aug 2026 · IEEE International Symposium on Robot and Human Interactive Communication · pp. 2503-2509 · 0 citations · 22 references

TL;DR

A crossmodal person-following system that couples three components that propagates identity-stable masks without requiring repeated per-frame detection, yields a highly robust tracking pipeline that effectively reduces the chance of permanent target loss, even during prolonged visual interruptions.

Abstract

Person following in crowded indoor environments remains challenging owing to occlusion-induced tracking loss and identity confusion among bystanders. We propose a crossmodal person-following system that couples three components: First, a video object segmentation tracker, initialized by a single click on the target person, propagates identity-stable masks without requiring repeated per-frame detection. Second, a parallel 2D LiDAR leg tracker projects its position estimate onto the image plane to support recovery when visual tracking becomes unreliable. Third, a dual-model Kalman filter with depth-scaled measurement noise maintains an accurate three-dimensional state estimate, adapting between steady walking and sudden maneuvers. In experiments across various occlusion conditions, the proposed system achieved up to a 31-point improvement in tracking availability and up to a 72-point reduction in non-tracking time ratio compared to conventional camera-based tracking. The proposed system yields a highly robust tracking pipeline that effectively reduces the chance of permanent target loss, even during prolonged visual interruptions.

Read PDF

Similar papers

#artificial intelligence Preprint Sep 2026

Tracking the Unseen: An Occlusion-Robust Framework for Target Tracking Under Full and Long-Term Occlusion

An occlusion-robust target tracking framework that maintains target identity and trajectory continuity through the integration of YOLOv11n object detection, Kalman Filter motion prediction, and occlusion-aware appearance-based re-identification is proposed.

Mais.M Mohammed, Sharifa Mohammed, Hanan Awadh et al. · 0 citations
Preprint Sep 2026

Human-Aware Target Tracking and Navigation: Fusing Kinematic State Estimation with Structural Map Constraints

This research presents an end-to-end autonomous navigation stack that addresses target occlusion through map-informed spatial reasoning, and features a multi-modal perception pipeline, fusing deep learning-based visual tracking with 2-dimensional LiDAR point clustering to maintain high-fidelity tracking of a tagged per...

Sagar Gupta, Don Gideon, S. Loke et al. · 0 citations
Open access Oct 2026

Visual-inertial odometry with adaptive image enhancement for low-light

A robust, tightly-coupled monocular VIO algorithm leveraging adaptive image enhancement and an improved adaptive gamma correction is proposed for image enhancement to restore feature saliency under adverse lighting conditions and a cascaded outlier rejection scheme is designed.

Xia You, Yan Jiang, Sheng-Jie Dong et al. · 0 citations
Preprint Oct 2026

RoPT: Robust 6DoF Object Pose Tracking in Video

Accurate 6-DoF object pose tracking is essential for robotic interaction, yet conventional monocular pipelines frequently suffer from catastrophic divergence under rapid object motion. We present RoPT, a robust tracking framework engineered to overcome this limitation by unifying visual perception, temporal kinematics,...

Yong-Qing Liang, Yu-Zhong Chen, Si-Hang Li et al. · 0 citations
Conference Oct 2026

Improved DeepSORT pedestrian tracking using lightweight horizontal-stripe features

Partial occlusion in low-altitude UAV imagery degrades pedestrian appearance cues, motion estimates, and target identity continuity. We propose an improved DeepSORT framework combining a global-local horizontal-stripe re-identification network (GLHS-ReID), an adaptive Kalman filter, and long-term appearance-memory-base...

Wen-Hao Guo, Xi-Fa Song, Shu-Xia Jing · 0 citations
Open access Oct 2026

Lightweight head-based multi-object tracking in crowded built environments

Multi-object tracking (MOT) provides an effective approach for occupant monitoring in intelligent built environments. Real-time MOT is challenging on resource-constrained edge devices. This study establishes a systematic evaluation framework for lightweight head-based MOT, examining structured channel pruning and quant...

Yu-Lai Cui, Zi-Jie Gao, Kai-Lai Sun · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.