The proposed OCR prior-guided cross-scale framework for text image super-resolution improves text readability while maintaining a reasonable accuracy–complexity trade-off and suggests that OCR priors are useful for text image reconstruction, but should be used as soft constraints when external recognition predictions are uncertain.
Abstract
Text image super-resolution aims to improve the readability of low-quality text images while preserving character structures, stroke details, and semantic consistency. Compared with natural image super-resolution, this task is more sensitive to structural distortion because small changes in stroke topology may lead to incorrect text recognition. To address this problem, this paper proposes an OCR prior-guided cross-scale framework for text image super-resolution. Specifically, character-level semantic priors extracted from a pretrained OCR model are introduced to provide structural guidance for degraded text reconstruction. A gated feature modulation mechanism is designed to adaptively regulate the contribution of OCR priors, reducing the influence of unreliable semantic predictions. A cross-scale dynamic attention module is also developed to aggregate multi-granularity visual features, enabling the model to jointly recover fine stroke boundaries and global character structures. In addition, a sequence-aware calibration module is introduced to improve structural consistency along the logical reading order of text. Experiments on mixed text image benchmarks and the TextZoom dataset show that the proposed method achieves competitive or better performance among the compared methods in terms of PSNR, SSIM, and recognition-oriented metrics. Additional ablation, OCR prior robustness, and computational complexity analyses further indicate that the proposed framework improves text readability while maintaining a reasonable accuracy–complexity trade-off. The results also suggest that OCR priors are useful for text image reconstruction, but should be used as soft constraints when external recognition predictions are uncertain.
MagnifiQ is introduced, an image restoration framework that progressively upscales and restores images across resolutions, e.g., from 1024x1024 to 4096x4096, and leverages a pre-trained text-to-image diffusion model such as SDXL and adapts it for more scalable high-resolution inference by replacing its original self-at...
M. Reddy, Yashesh Savani, Antoine Mercier et al.· 0 citations
A training-free Dual-path Attention Modulation (DAR) framework that decouples semantic edits while preserving source image structure is proposed and Adaptive Self-Attention (ASA) and Adaptive Cross-Attention (ACA) modules that dynamically regulate attention replacement are introduced.
Tong Cui, Jie Yang, Kai-Ru Li et al.· International Conference on...· 0 citations
Text-rich scene image super-resolution (TS-ISR) aims to recover high-quality images with legible text from degraded inputs, benefiting mobile photography and enhancing visual inputs for multimodal understanding. Existing methods rely on real-world image super-resolution or text image super-resolution, making it difficu...
Na Jiang, Yuxuan Qiu, Jia-Wei Zhang et al.· IEEE Transactions on Image P...· 0 citations
A GAN-based method for generating images from text by introducing multi-kernel convolution into the generator and replacing standard convolutions with multi-layer nested convolutions combined with dynamic gating weighting is proposed, thereby improving the fine-grained quality of generated images.
Pengkui Wang, Xiao-Sheng Cai· International Conference on...· 0 citations
TGFusion is proposed, a text-guided latent-space flow matching framework that unifies degradation suppression and cross-modal fusion and achieves superior or competitive performance in perceptual quality, image naturalness, structural-detail preservation, and infrared-saliency retention, while remaining robust across d...
Axi Niu, Jiehua Li, Kang Zhang et al.· 0 citations
This paper proposes an iterative text-guided image fusion framework that incorporates text-conditioned feature interaction across multiple fusion and refinement stages, and provides degradation-aware global semantic conditioning while preserving complementary information from the visible and infrared modalities.
Si-Yang Liu, Pei Zhou, Tianhu Jin et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.