Skip to content
Preprint

UniWorld-Design: From Pixel Generation to Layer-Native Design

Aug 2026 · 0 citations · 39 references
Computer Science

Abstract

We introduce UniWorld-Design, a framework that redefines image generation from flat pixel synthesis to structured visual composition, with semantic RGBA layers as the atomic units of generation, understanding, and editing. Our key insight is that pixels define how an image is rendered, whereas layers define how an image is created, understood, and edited. Just as human designers create and manipulate visual content through layers rather than raw pixels, UniWorld-Design equips multimodal generative models with a layer-native design space. UniWorld-Design comprises two models. The Text-to-RGBA (T2RGBA) model generates standalone RGBA assets directly from text. The Image-to-Layer (I2L) model conditions on a finished image, a global instruction and per-layer prompts, and jointly produces ordered, complete semantic RGBA layers. Its instruction interface supports top-level decomposition, recursive decomposition and targeted extraction, making layering an instruction-addressable operation for agentic editing. Because I2L learns complete semantic objects rather than visible-pixel partitions, its layers stay usable when moved or removed. On the Crello benchmark, I2L reduces per-layer RGB L1 error by 37% and achieves a 34% relative improvement in Alpha Soft IoU over Qwen-Image-Layered. Separately, T2RGBA achieves the highest CLIP Score, outperforming LayerDiffuse and OmniAlpha.

View source

Similar papers

#computer vision Preprint Sep 2026

Editable Visual Design

Editable Visual Design is proposed, a new paradigm driven by a Coding Agent that achieves both refined aesthetics and production-grade editability and faithfully reproduces the creative and reasoning trajectory akin to that of professional human designers.

Jun-Yan Ye, Wei Liu, Dongzhi Jiang et al. · 0 citations
Book Open access Jul 2026

AI for Creative Visual Content Generation Editing and Understanding

The goal is not to present AI as a replacement for artists, but to show how controllable AI systems can support more precise, collaborative, and extensible forms of creative production.

Zheng Wei, Yuying Tang, Mia Tang et al. · 0 citations
Preprint Aug 2026

Beyond Atomic Layouts: Compositional Design Understanding with Vision-Language Models

A post-training paradigm that integrates multimodal alignment (MA) and structural perception (SP) is proposed, MA enhances element interpretation by grounding metadata-defined elements to their visual counterparts, mitigating semantic drift, and SP models layer-aware inter-element spatial relationships to improve hiera...

Yiyang Huang, Zhao-Wen Wang, Simon Jenni et al. · 0 citations
#computer vision Preprint Sep 2026

On the Design Fundamentals of Pixel Text Representation Learning

This work investigates the fundamental design principles required for robust visual text representation learning and trains Pixel Linguist II, a native-resolution vision encoder trained with on-the-fly rendering, unified contrastive grounding, and a multilingual curriculum over 280M training examples.

Chaohao Yuan, Rui-Feng Yuan, Zhuoxu Huang et al. · 2 citations
Preprint Sep 2026

SenseNova-U1.5: Towards Native Unified Visual Intelligence

Native unified modelling is position as a promising path towards systems that perceive, reason and create within a fully end-to-end framework through SenseNova-U1.5, an 8B-MoT native unified multimodal model that understands, reasons about, and generates visual content within an encoder-free and VAE-free architecture.

Hai-Wen Diao, Jia-Hao Wang, Chen-Jing Ding et al. · 3 citations
Jul 2026

Show, Don't Tell: Evaluating Spatial Cognition in Generative Pixels Rather Than LLM Text

ProVisE (Protocolized Visual Evaluation), a benchmark-agnostic framework that elicits protocol-constrained visual answers from image-generation models and parses them into structured predictions compatible with original metrics, is proposed and revealed, revealing complementary strengths of pixel-space expression and t...

Xu Wang, Kaixiang Yao, Miao Pan et al. · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.