Skip to content

Scientific Graphics Program Synthesis via Dual Self-Consistency Reinforcement Learning

Apr 2026 · arXiv.org · Vol abs/2604.06079 · 5 citations · 64 references
Computer Science

TL;DR

A novel Dual Self-Consistency Reinforcement Learning optimization paradigm is introduced, which utilizes Round-Trip Verification to penalize degenerate code and boost overall self-consistency in TikZ code.

Abstract

Graphics Program Synthesis is pivotal for interpreting and editing visual data, effectively facilitating the reverse-engineering of static visuals into editable TikZ code. While TikZ is the de facto standard for scientific schematics due to its programmatic flexibility, its requirement for rigorous spatial precision presents a significant challenge for Multimodal Large Language Models. Progress is currently stifled by two primary gaps: (1) Data Quality Gap: existing image-TikZ corpora often lack strict executability and reliable visual alignment; (2) Evaluation Gap: a lack of benchmarks for both structural and visual fidelity. To address these, we present a closed-loop framework featuring: SciTikZ-230K, a large-scale, high-quality dataset from our Execution-Centric Data Engine covering 11 diverse scientific disciplines; SciTikZ-Bench, a multifaceted benchmark spanning from basic geometric constructs to intricate hierarchical schematics to evaluate both visual fidelity and structural logic. To further broaden the scope of visual-code optimization methodology, we introduce a novel Dual Self-Consistency Reinforcement Learning optimization paradigm, which utilizes Round-Trip Verification to penalize degenerate code and boost overall self-consistency. Empowered by these, our trained model SciTikZer-8B achieves state-of-the-art performance, consistently outperforming proprietary giants like Gemini-2.5-Pro and massive models like Qwen3-VL-235B-A22B-Instruct.

View source

Similar papers

Preprint Aug 2026

Exploring the Performance Frontier of Compact Unified Image Generation Models

Swift-Image achieves leading aggregate performance among evaluated open-source models with only 6B parameters and 243K GPU training hours; the compressed 3B model incurs nearly no loss, while few-step distillation further improves aggregate editing performance with substantially fewer sampling steps.

Taihang Hu, Zhaowen Wang, Zuan Gao et al. · 1 citation · ⚡1
Preprint Aug 2026

Edit2TikZ: A Comprehensive and Challenging Benchmark for Scientific Figure Editing with TikZ

This work introduces Edit2TikZ, a comprehensive benchmark for scientific figure editing tasks, featuring 1,548 diverse and high-quality samples, and constructs a human-aligned evaluation framework to measure whether a requested edit is completed while irrelevant content is preserved.

Zong-Yun Zhang, Jiacheng Ruan, Xian Gao et al. · 0 citations
Preprint Sep 2026

VectorHarness: Recovering Editable, Relation-Preserving Structure from Scientific Graphics

VectorHarness is presented, a multi-agent framework for raster-to-authoring reconstruction that recovers heterogeneous components using type-appropriate native representations that recovers heterogeneous components using type-appropriate native representations.

Jia-Hao Tang, Yi-Ren Song, Alex Jinpeng Wang · 0 citations

FlowLess: Controlling Abstract Image Generation

A novel self-supervised framework that enables granular control over image generation through a visual abstraction set that provides a richer, more flexible paradigm for creative design compared to state-of-the-art baselines across diverse styles and compositions is introduced.

Amir Hertz, Noah Snavely, Google DeepMind · 0 citations
Preprint Aug 2026

SI-Edit: Toward Sketch-Instruction Guided Local Image Editing with Pixel-Level Precision

An automated pipeline leveraging Multimodal Large Language Models (MLLMs) is developed to synthesize comprehensive quadruplets comprising original images, local geometric sketches, semantic instructions, and corresponding edited images, which uniquely enables collaborative spatial-semantic learning.

Weixin Ye, Wei Wang, Hong-Guang Zhu et al. · 0 citations
Preprint Sep 2026

GenPuzzle: Benchmarking Visual Reasoning in Image Generation Models

GenPuzzle provides a testbed for measuring progress from image rendering toward visual problem solving, and uses task-specific evaluation protocols that select the automatic judge by measuring agreement with human reference scores.

Chang-Peng Zhao, Yi-Ren Song, Jin-Peng Wang · 1 citation

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.