2026· IEEE Transactions on Image Processing· Vol 35, pp. 11060-11075· 0 citations· 79 references
TL;DR
A heuristic visual localization and causal semantic reasoning (HVLCSR) framework is proposed, which consists of a multi-scale prompt-guided visual localization module (MPVLM) and a causal semantic relationship building module (CSRBM) that progressively interprets the content of RS images by reasoning from the global scene down to specific land covers.
Abstract
Multi-label remote sensing (RS) scene classification aims to describe RS images according to the contained land covers. Existing methods typically focus on two aspects: visual learning to extract class-relevant regions and semantic modeling to uncover potential label relationships. However, as observation ranges expand and spatial resolution improves, variations in the quantity, scale, and spatial distribution of land covers become increasingly pronounced, which limits the effectiveness of existing methods when applied to modern RS images. To respond to the above difficulties and improve final results, a heuristic visual localization and causal semantic reasoning (HVLCSR) framework is proposed, which consists of a multi-scale prompt-guided visual localization module (MPVLM) and a causal semantic relationship building module (CSRBM). Specifically, MPVLM first employs a non-discriminative localization mechanism to mitigate insufficient feature discriminability in RS scenarios. Subsequently, tailored regularization and multi-scale weighting schemes are incorporated to further address the challenge of large variations in land covers. Therefore, MPVLM is capable of extracting visual features associated with land covers efficiently. Correspondingly, inspired by human cognitive strategies, CSRBM progressively interprets the content of RS images by reasoning from the global scene down to specific land covers. It begins by capturing scene clues from the input image. Next, land covers are divided into typical and indistinct groups based on their inherent attributes and relevance to the identified scene. Ultimately, hierarchical “scene $\rightarrow $ typical $\rightarrow $ indistinct” semantic relationships are constructed based on the state space model. Extensive comparative experiments and ablation studies implemented on three public benchmark data sets demonstrate the superiority of our HVLCSR. Our source codes are available at https://github.com/TangXu-Group/HVLCSR
Zero-shot remote sensing image scene classification aims to recognize unseen categories by leveraging the mapping between vision and semantic information. The robustness of scene attributes is crucial to the semantic transfer of zero-shot learning (ZSL). However, different acquisition conditions cause instance attribut...
Yang Zhao, Jing Li, Meng-Yang Li et al.· IEEE Geoscience and Remote S...· 0 citations
A Dual Category-Guided Spatial Mamba Network (DGSMNet) that combines dual category guidance with a spatial Mamba mechanism is proposed that improves category-aware representation and spatial modeling on the evaluated benchmarks.
Ting-Ting Pan, An-Yu Du, Shu-Li Cheng et al.· Remote Sensing· 0 citations
Semantic segmentation is a fundamental task in remote sensing image (RSI) interpretation, aiming at pixel-wise classification of land cover. Recently, multimodal RSI semantic segmentation has attracted significant attention for its ability to alleviate the information bottleneck inherent in unimodal methods. However, e...
Guang-Yi Wei, Qian-Peng Chong, Zhen-Xi Wang et al.· IEEE Transactions on Geoscie...· 0 citations
A Cross-Scale Sparse Attention Model (CSSAM), which aligns multiscale visual features with complex referring expressions through two key modules, and introduces M$^{3}RRSIS-D, a RRSIS dataset explicitly designed around three core reasoning dimensions: multi-target, reference-dependent multi-hop, and multi-granularity e...
Multilabel remote sensing scene classification (ML-RSSC) aims to assign multiple semantic labels to complex high-resolution scenes. Although exhaustive expert annotation enables accurate supervision, its high cost limits large-scale applications. Low-cost labels from crowdsourcing, existing geographic products, or weak...
Xiao-Man Qi, Xing-Rui Zeng, Xiao-Tong Qi et al.· IEEE Journal of Selected Top...· 0 citations
Remote sensing open-vocabulary object detection (RSOVD) aims to detect objects beyond the categories annotated during training. Although vision–language models (VLMs) have significantly advanced this task, existing approaches often suffer from region-level semantic instability, where region representations are highly s...
Ming Liu, Jing Li, Dong Ren et al.· IEEE Transactions on Geoscie...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.