Skip to content
Open access

Uncertainty-Aware General Gaze Following via Circular Direction Distribution Learning and Probabilistic Gaze Geometry Modeling

Aug 2026 · Journal of Eye Movement Research · Vol 19, pp. 88 · 0 citations · 62 references
Medicine

TL;DR

Results of controlled experiments on GazeFollow demonstrate competitive localization and support the contribution of direction-distribution learning and channel-wise geometric projection, and indicate interpretable behavior together with domain-dependent and computational trade-offs.

Abstract

General gaze following aims to infer the region attended to by a person within a natural scene and offers a computational perspective on visual attention and social scene understanding. Existing direction-guided methods usually reduce gaze direction to a single vector or spatial mask. This deterministic treatment can obscure directional ambiguity, discard coexisting candidate directions, and propagate early estimation errors to gaze target localization when head cues are weak or multiple targets are plausible. To address these limitations, we propose an uncertainty-aware framework based on Circular Direction Distribution Learning (CDDL) and Probabilistic Gaze Geometry Modeling (PGGM). CDDL represents gaze direction as a 72-bin circular probability distribution under von Mises soft supervision, thereby preserving neighboring directional hypotheses before target localization. Rather than predicting a target space distribution directly, PGGM aggregates the direction distribution into 18 groups and projects the retained hypotheses into cone-like spatial probability fields, allowing spatial tolerance to expand with distance while preserving a channel-wise direction-to-region representation. The full probability volume is fused with the RGB scene image at the input level and processed by a ResNet-50-FPN network for gaze heatmap prediction. Controlled experiments on GazeFollow demonstrate competitive localization and support the contribution of direction-distribution learning and channel-wise geometric projection. Zero-shot transfer, dataset-level uncertainty and failure analyses, efficiency measurements, and qualitative results further indicate interpretable behavior together with domain-dependent and computational trade-offs.

Read PDF

Similar papers

#machine learning Preprint Sep 2026

GazeFlow: From Human Gaze Behavior to Generative Egocentric Gaze Prediction

Egocentric gaze prediction enables many downstream applications but remains challenging, as human gaze is inherently stochastic. This stochasticity is constrained by structured temporal dynamics alternating between fixations and saccades, top-down influences from tasks, and bottom-up visual saliency. Based on this obse...

Sheng Zhao, Wei-Kai Lin, Yu-Hao Zhu · 0 citations
Sep 2026

AttentiveGaze: an uncertainty-aware multimodal feature fusion for robust gaze estimation

AttentiveGaze is presented, a multi-modal framework for robust gaze estimation that addresses critical challenges in real-world deployment, including adaptive feature fusion across heterogeneous visual cues and reliable uncertainty quantification.

P. Choksy, Heena Patel, Anirban Chowdhury et al. · 0 citations
Conference Sep 2026

Rotated bivariate Gaussian model for gaze-based pointing endpoint distribution modeling

Endpoint distribution modeling constitutes an important research topic in the field of human-computer interaction, as it reflects the user's psychological state and decision-making process during interaction, and holds significant implications for the design of interaction assistance. We investigate how the direction o...

Shan-Feng Fu · 0 citations
Preprint Sep 2026

GazeDiT: Gaze-Accurate Diffusion Image Generation for Eye Tracking via Spatial Conditioning

GazeDiT is introduced, a diffusion model that generates images for a requested 4D gaze through an internally constructed spatial condition that grounds the global gaze label in this local geometry, and achieves substantially lower tail gaze-label error than other diffusion baselines.

Dong-Ze Wu, David Colmenares, Feng-Ting Yang et al. · 0 citations
Preprint Sep 2026

Self-Supervised Multi-View 3D Gaze Target Estimation via Probabilistic Ray Marching

We present a self-supervised approach, Self-MVGTE, for estimating 3D gaze targets from multiple camera views. Unlike existing methods that independently estimate 2D gaze targets per camera view, Self-MVGTE predicts gaze targets directly in 3D space for the first time. Moreover, it does not require any ground-truth anno...

Ke-Qi Chen, V. Srivastav, N. Padoy · 0 citations
Preprint Sep 2026

Attention-DP3: Spatially Object-aware 3D Diffusion Policy via Geometry-aligned Attentional Conditioning

3D point-cloud observations are inherently ambiguous in complex, cluttered manipulation scenes, where target objects may be partially occluded or tightly intermingled with visually similar distractors. As a result, standard 3D diffusion policies often struggle to localize and exploit task-relevant geometry as scene com...

Chang-Bo Yan, Zhong-Bo Zhang, Zai-Bin Zhang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.