Skip to content

CLIP-SGI: A Semantic-Guided and Instance-Consistent Framework for Generalizable Person Re-Identification

Aug 2026 · IEEE Transactions on Image Processing · Vol 35, pp. 9620-9634 · 0 citations · 73 references
Medicine

TL;DR

This work proposes CLIP-SGI, a semantic-guided and instance-consistent framework for generalizable person ReID that combines semantic guidance, domain-aware representation learning, and instance consistency to improve robustness under domain shifts.

Abstract

Generalizable person re-identification (ReID) requires a model trained on labeled source domains to remain discriminative in unseen environments. Although vision-language models provide rich cross-modal priors, the appearance semantics used by CLIP-based ReID are often encoded implicitly in learned prompts and are not explicitly organized into reusable part-level cues. Moreover, conventional identity supervision mainly emphasizes the separation of source identities and makes limited use of the local relationships among visually similar instances. To address these issues, we propose CLIP-SGI, a semantic-guided and instance-consistent framework for generalizable person ReID. First, multiple off-the-shelf vision-language models generate pedestrian descriptions. For each VLM, upper- and lower-body attributes are first voted across images of the same identity and then across the VLM-specific identity labels. Second, we construct an Attribute Prototype Bank (APB) that uses the resulting attributes as region-aware semantic anchors to guide appearance-sensitive feature learning. Third, we introduce a similarity-aware and frequency-normalized soft-label constraint that preserves ground-truth identity supervision while exploiting reliable neighborhood relationships as auxiliary signals. The three-stage training scheme combines semantic guidance, domain-aware representation learning, and instance consistency to improve robustness under domain shifts. Extensive experiments on multiple benchmark datasets demonstrate the effectiveness of the proposed method and its consistent improvements in mean average precision (mAP) and Rank-1 (R1) accuracy.

View source

Similar papers

Aug 2026

CATSANet: cross-modal semantic token selection and optimal transport based part alignment for text-to-image person ReID

The proposed Cross-Modal Adaptive Token Selection and Alignment Network (CATSANet), a CLIP-based framework tailored for TI-ReID, achieves competitive performance in terms of Rank-k accuracy and mAP, demonstrating the effectiveness of fine-grained alignment and ranking refinement across datasets.

Dongbin Chen, Junjie Li, Hao Xu et al. · 0 citations
Preprint Aug 2026

FaLCon: Facet-Anchored Retrieval with Late Consensus for Sim2Real Text-Based Person Anomaly Search

Text-based person anomaly search requires retrieving real-world pedestrian images from detailed natural-language descriptions using models trained primarily on synthetic data. This Sim2Real setting is particularly challenging because visually similar candidates may differ only in subtle actions, object interactions, or...

H. Pham, P. Tran, Thuan Duc Mai et al. · 1 citation
Aug 2026

IRPP: Invariant Representation Learning With Progressive Prototype Refinement for Unsupervised Person Re-Identification

Unsupervised person re-identification (USL-ReID) typically relies on clustering to generate pseudo-labels, but significant cross-view appearance variations often cause images of the same identity to be split into different clusters. Training on such noisy pseudo-labels severely degrades the learned representations. The...

Xuan Tan, Qi-Xian Zhang, Ding Qi et al. · 0 citations
Jul 2026

Multi-Level Semantic-Guided Framework for Cloth-Changing Person Re-Identification

A Multi-level Semantic-Guided (MSG) framework that integrates contextual and fine-grained visual information to eliminate clothing variance across both conceptual and pixel dimensions is proposed.

Shijuan Huang, Hefei Ling, Zongyi Li et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.