Aug 2026· IEEE Transactions on Image Processing· Vol 35, pp. 9620-9634· 0 citations· 73 references
Medicine
TL;DR
This work proposes CLIP-SGI, a semantic-guided and instance-consistent framework for generalizable person ReID that combines semantic guidance, domain-aware representation learning, and instance consistency to improve robustness under domain shifts.
Abstract
Generalizable person re-identification (ReID) requires a model trained on labeled source domains to remain discriminative in unseen environments. Although vision-language models provide rich cross-modal priors, the appearance semantics used by CLIP-based ReID are often encoded implicitly in learned prompts and are not explicitly organized into reusable part-level cues. Moreover, conventional identity supervision mainly emphasizes the separation of source identities and makes limited use of the local relationships among visually similar instances. To address these issues, we propose CLIP-SGI, a semantic-guided and instance-consistent framework for generalizable person ReID. First, multiple off-the-shelf vision-language models generate pedestrian descriptions. For each VLM, upper- and lower-body attributes are first voted across images of the same identity and then across the VLM-specific identity labels. Second, we construct an Attribute Prototype Bank (APB) that uses the resulting attributes as region-aware semantic anchors to guide appearance-sensitive feature learning. Third, we introduce a similarity-aware and frequency-normalized soft-label constraint that preserves ground-truth identity supervision while exploiting reliable neighborhood relationships as auxiliary signals. The three-stage training scheme combines semantic guidance, domain-aware representation learning, and instance consistency to improve robustness under domain shifts. Extensive experiments on multiple benchmark datasets demonstrate the effectiveness of the proposed method and its consistent improvements in mean average precision (mAP) and Rank-1 (R1) accuracy.
The proposed Cross-Modal Adaptive Token Selection and Alignment Network (CATSANet), a CLIP-based framework tailored for TI-ReID, achieves competitive performance in terms of Rank-k accuracy and mAP, demonstrating the effectiveness of fine-grained alignment and ranking refinement across datasets.
Dongbin Chen, Junjie Li, Hao Xu et al.· Pattern Analysis and Applica...· 0 citations
Text-based person anomaly search requires retrieving real-world pedestrian images from detailed natural-language descriptions using models trained primarily on synthetic data. This Sim2Real setting is particularly challenging because visually similar candidates may differ only in subtle actions, object interactions, or...
H. Pham, P. Tran, Thuan Duc Mai et al.· 1 citation
Unsupervised person re-identification (USL-ReID) typically relies on clustering to generate pseudo-labels, but significant cross-view appearance variations often cause images of the same identity to be split into different clusters. Training on such noisy pseudo-labels severely degrades the learned representations. The...
Xuan Tan, Qi-Xian Zhang, Ding Qi et al.· IEEE Transactions on Image P...· 0 citations
Experimental results on multiple benchmark datasets demonstrate that the UGCL framework exhibits favorable robustness and competitive performance under both noisy and noise-free correspondence conditions.
Wen Ting, Shidu Dong, Yuzhi Zhang et al.· Machine Vision and Applicati...· 0 citations
A Multi-level Semantic-Guided (MSG) framework that integrates contextual and fine-grained visual information to eliminate clothing variance across both conceptual and pixel dimensions is proposed.
Shijuan Huang, Hefei Ling, Zongyi Li et al.· ACM Transactions on Multimed...· 0 citations