Skip to content
Preprint

SciGen-Verifier: A Multimodal Reasoner for Explainable Verification in Scientific Image Generation

Sep 2026 · 0 citations · 45 references
Computer Science

TL;DR

SciGen-Verifier is constructed, a reasoning-driven multimodal verifier trained via cold-start supervised fine-tuning followed by a curriculum-based two-stage reinforcement learning pipeline that achieves competitive performance against much larger proprietary models.

Abstract

In realistic education, a solution is often expressed not only in words but in a drawing--a circuit, a geometric construction, a function plot--and a teacher must grade the drawing as carefully as the text. Recent advances in unified multimodal models have enabled scientific image generation, yet verifying the correctness of these specialized visual outputs remains a critical bottleneck: errors often arise from intricate domain knowledge, structural reasoning, and multi-step instruction rather than surface-level artifacts. Existing verifiers mainly target natural images and compress judgement into scalar scores, leaving scientific coverage and explainable feedback for error correction underexplored. To bridge this gap, we make three main contributions. (1) We construct SciGen-Verify, a benchmark dedicated to explainable verification of scientific image generation, spanning instruction following, multidisciplinary reasoning, and world knowledge domains. It contains a three-tier hierarchical protocol over the binary judgement, supporting explanation, and corrective editing instruction. (2) We develop SciGen-Verifier, a reasoning-driven multimodal verifier trained via cold-start supervised fine-tuning followed by a curriculum-based two-stage reinforcement learning pipeline. The rubric-guided process rewards first strengthen scientific reasoning exploration and outcome rewards subsequently align output with ground-truth annotation. (3) On SciGen-Verify, SciGen-Verifier achieves competitive performance against much larger proprietary models. It further serves as a practical online critic for iterative image rectification.

View source

Similar papers

Preprint Sep 2026

GenPuzzle: Benchmarking Visual Reasoning in Image Generation Models

GenPuzzle provides a testbed for measuring progress from image rendering toward visual problem solving, and uses task-specific evaluation protocols that select the automatic judge by measuring agreement with human reference scores.

Chang-Peng Zhao, Yi-Ren Song, Jin-Peng Wang · 1 citation
#artificial intelligence Preprint Sep 2026

VIF-Bench: Evaluating Visual Instruction Following in Multi-Reference Image Generation

Recent multimodal image generation models can take multiple images and textual instructions as input, enabling reference-based generation guided not only by text but also by visual instructions such as layouts, arrows, and pose cues. However, existing benchmarks do not evaluate the joint setting in which multiple refer...

Yuta Oshima, Masakazu Yoshimura, Masahiro Suzuki et al. · 0 citations
Preprint Sep 2026

MaLiang-Harness: A Programmable Path to Image and Video Generation

Executable programs offer explicit control over how images and videos are constructed, but generating runnable code is only the beginning of visual creation. A program can execute correctly while violating the requested composition, appearance, or motion. We define this discrepancy as the Program-to-Visual (P2V) gap an...

Hao-Yu Zhao, Zi-Hao Zhang, Xu-Dong Wang et al. · 0 citations
Preprint Aug 2026

Edit2TikZ: A Comprehensive and Challenging Benchmark for Scientific Figure Editing with TikZ

This work introduces Edit2TikZ, a comprehensive benchmark for scientific figure editing tasks, featuring 1,548 diverse and high-quality samples, and constructs a human-aligned evaluation framework to measure whether a requested edit is completed while irrelevant content is preserved.

Zong-Yun Zhang, Jiacheng Ruan, Xian Gao et al. · 0 citations
Preprint Aug 2026

MechReason: Benchmarking Multi-Image Multi-Hop Reasoning in Mechanical Engineering

MechReason is a benchmark derived from real mechanical engineering papers, comprising 12k question-answer pairs with explicit reasoning-chain annotations and 21k visual materials spanning nine evidence types, including statistical charts, parameter tables, engineering drawings, microscopic images, simulation images, sy...

Tengyue Wang, Kang An, Chenxu Du et al. · 0 citations
Preprint Aug 2026

Math-Vision Diagrams: A Comprehensive Benchmark for Evaluating LLM Mathematical Diagram Generation Capabilities

The generation of mathematically precise diagrams from tex- tual prompts has emerged as a critical yet underexplored capability of Large Language Models (LLMs). This has been of interest to researchers in the areas of curriculum preparation, automated ranking of problem sets, and scientific publishing. For LLMs to achi...

Harish Kashyap, K. Byadarhaly, S. Chakaravarthy et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.