Skip to content

Evaluating domain generalization of product image quality assessment models using AI-generated images

Jul 2026 · Multimedia Systems · Vol 32 · 0 citations · 26 references

TL;DR

The findings demonstrate that AI-generated images serve as an effective diagnostic tool for robustness evaluation and failure mode analysis, and supports reliable deployment of product image quality assessment models and highlights the value of synthetic data as a structured robustness testing resource in multimedia and e-commerce systems.

View source

Similar papers

Preprint Jul 2026

Patch Knowledge Transfer for Efficient AI-Generated Image Quality Assessment

With the rapid advancement of image generation technologies, perceptual quality assessment of AI-generated images has emerged as a crucial research direction in computer vision. The core challenge of this task lies in achieving efficient quality assessment for massive generated images. Current mainstream approaches exhibit two key limitations: 1) Methods employing complex feature extraction strategies, while improving performance, incur prohibitive computational costs that hinder real-time inference; 2) Simple image scaling-based solutions, despite their computational efficiency, demonstrate significantly inferior assessment accuracy. To address this critical issue, we propose Patch Knowledge Transfer (PKT), a knowledge distillation-based optimization framework that achieves synergistic optimization of visual representation capability and inference efficiency through an innovative multi-level knowledge transfer mechanism. Specifically, we design a dual-model architecture: a teacher model with local-global hybrid processing provides high-quality supervision signals, while a student model relying solely on global processing efficiently inherits the teacher's representation capacity through multi-level supervision. Extensive experiments conducted on 4 AIGIQA databases demonstrate that the PKT framework enables the student model to maintain performance comparable to the teacher while reducing computational costs by 67.7\%. Furthermore, compared to existing methods, our approach achieves a superior balance between model efficiency and assessment accuracy.

Jiquan Yuan · 0 citations
Preprint Aug 2026

Visual Distortion Detection in UGC Images Using Large Multimodal Models

This model leverages different layers of the large language model (LLM) decoder, treating them as multiple detectors that perform synchronous distortion detection using multi-level features, which helps mitigate the ambiguous foreground-background separation commonly encountered in the S2A problem.

Ziheng Jia, Yingji Liang, Jiaying Qian et al. · 0 citations
Jul 2026

A Comparative Analysis of Feature-Based and Deep Learning Approaches for Image Classification

Tremendous numbers of images and videos are generated throughout the life cycle of construction projects, offering rich visual data that, if analysed effectively, can support automation in progress monitoring, safety management, quality control, and productivity tracking. Within this context, image classification plays a foundational role: it is the supervised task of mapping an image to one of K semantic categories by learning from labelled examples, requiring the extraction of discriminative visual structure and the production of calibrated class predictions. Despite major advances from handcrafted feature pipelines to Convolutional Neural Networks (CNNs), fair comparison across methods remains challenging due to inconsistent preprocessing, dataset splits, training budgets, and reporting standards. This paper introduces a unified and fully reproducible benchmarking framework that standardises preprocessing, enforces fixed train–test splits, aligns training configurations, and evaluates models using a consistent multi-metric suite. Under identical experimental conditions, we benchmark four paradigm families: classical machine learning (ML) models, handcrafted feature-based methods (Histogram of Oriented Gradients (HOG), Local Binary Patterns (LBP), Bag-of-Visual-Words (BoVW) [Formula: see text] Support Vector Machine (SVM)), and CNNs (LeNet-5, ResNet-18), across three datasets (MNIST, Fashion-MNIST, CIFAR-10). We formalise image classification mathematically as a supervised learning problem and assess performance using accuracy, macro-averaged [Formula: see text]1-score, and macro-averaged ROC–AUC, complemented by learning-curve and robustness analyses. Results show that ResNet-18 achieves the strongest performance on all datasets (98.95%, 90.27%, 72.90%), SVM with a Radial Basis Function (RBF) kernel remains competitive on grayscale benchmarks, and hand-crafted pipelines degrade sharply on CIFAR-10. ROC–AUC analysis further highlights calibration–accuracy discrepancies, such as Naïve Bayes achieving high AUC but modest accuracy on MNIST. These findings emphasise the importance of task-aware model selection and demonstrate that compute-aligned, multi-metric benchmarking is essential for fair and reproducible cross-paradigm evaluation. All CNN results are reported under a 50-epoch training budget, which represents a lower bound on converged performance; future extensions will incorporate domain-specific datasets and pre-trained architectures to broaden practical applicability.

Yasir Hamid, N. Ababneh, A. Abasi et al. · 0 citations
Preprint Aug 2026

Generated Images Are Easier to Forget: A Machine Unlearning Perspective for Synthetic Image Detection

This work establishes a new paradigm for generated image detection by recasting the detection task as a problem of machine unlearning, and introduces two detection methods: data-free detection, which prunes model parameters to induce unlearning without data access, and data-driven detection, which optimizes LVMs to unlearn knowledge tied to generated images.

Jun Nie, Yonggang Zhang, Tongliang Liu et al. · 0 citations