Multimodal Large Language Models (MLLMs) have been increasingly adopted to automate webpage generation from visual designs (e.g., screenshots). However, existing evaluations are limited to visual fidelity assessment under a fixed browser-device configuration. Such a setting overlooks the cross-environment rendering com...
Ziyun Guo, Jingyu Xiao, Yu-Qiang Sun et al.· 0 citations
This work proposes a framework for quality-aware preference learning that guides LLMs toward generating criteria-compliant code and introduces a hybrid optimization objective that combines ranking loss with language modeling loss and KL divergence to enable effective comparative optimization.
Liang Lu, Yuan Jiang, Christoph Treude et al.· 2 citations
This work proposes ComUICoder, a component-based UI code generation framework that emphasizes semantic-aware segmentation, code reuse, and fine-grained refinement and significantly improves overall generation quality and code reusability on complex multipage websites.
Jingyu Xiao, Jiantong Qin, Shuo-Qiu Li et al.· Proceedings of the 32nd ACM...· 1 citation
Convergent Detour Hijacking is introduced, a text-only, runtime-independent attack that couples selection manipulation, malicious skill instructions, and tool-chain resource amplification largely separately and evaluates it across multiple LLM backends and 491 held-out tasks under single-task and multi-turn conditions.
Junliang Liu, Ruo-Yu Li, Wenxin Tang et al.· 1 citation
Results show that combining layout compaction, adaptive configuration, and instruction-aware pruning can make multimodal code understanding more efficient, and propose CodeShrink, an adaptive visual compression framework with three components.
Wenxin Tang, Jingyu Xiao, Zhen-Yu Liu et al.· arXiv.org· 1 citation
This survey reviews Multimodal Code Intelligence, covering systems that generate, edit, refine, or reason with code under visually grounded inputs and outputs and organizes benchmarks and methods into four domains: Graphical User Interface, Scientific Visualization, Structured Graphics, and Frontier Tasks and Framework...
VisualRepair is proposed, an MLLM-based framework for visual software issue repair comprising two core modules: Image Type-aware Tool Calling (ITTC), which classifies input images and dynamically invokes a tailored tool-calling chain for robust visual interpretation, and Dynamic Test-time Region Focusing (DTRF), which...
This work proposes ComUICoder, a component-based UI code generation framework that emphasizes semantic-aware segmentation, code reuse, and fine-grained refinement and significantly improves overall generation quality and code reusability on complex multipage websites.
Jingyu Xiao, Jiantong Qin, ShuoQiu Li et al.· Proceedings of the 32nd ACM...· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
