Skip to content
Open access

Agentic Designer: Progressive Multi-Agent Collaboration for Structure-Aware Interior Layout Generation.

Jul 2026 · IEEE Transactions on Pattern Analysis and Machine Intelligence · Vol PP, pp. 1-16 · 1 citation · 44 references
Medicine Computer Science

TL;DR

Agentic Designer is proposed, a progressive, multi-agent framework that formulates structure-aware interior layout generation as an iterative and constraint-verified decision process and significantly outperforms state-of-the-art methods, demonstrating substantial improvements in strict structural adherence and functional design coherence.

Abstract

Generating realistic interior furniture layouts that strictly adhere to architectural constraints (e.g., walls, doors, and windows) remains a fundamental challenge in automated spatial design. Existing approaches, primarily based on one-shot generation using diffusion models or Large Language Models (LLMs), lack explicit mechanisms for intermediate geometric constraint verification, often resulting in structural collisions and functionally infeasible arrangements under complex room constraints. To address these challenges, we propose Agentic Designer, a progressive, multi-agent framework that formulates structure-aware interior layout generation as an iterative and constraint-verified decision process. By decomposing layout synthesis into modular stages of proposal, verification, and adjustment, the framework coordinates three specialized agents, a Generator, an Evaluator, and a Refiner, through a Progressive Consensus Mechanism. This mechanism enforces stepwise geometric validation and correction before each placement is committed, thereby preventing error accumulation. To facilitate this structure-aware paradigm and standardize evaluation, we establish InStruct, a comprehensive benchmark that integrates a dataset comprising over 18,000 high-quality, parametrically annotated samples with a novel suite of structure-centric metrics. Extensive quantitative evaluations, qualitative analyses, and user studies show that Agentic Designer significantly outperforms state-of-the-art methods, demonstrating substantial improvements in strict structural adherence and functional design coherence.

Read PDF

Similar papers

Preprint Aug 2026

aDSL: Agentic 3D Creation via Joint Agent-Program Design

Programmatic representations provide a compelling paradigm for 3D content creation, enabling fine-grained edits, interpretability, and explicit structural control. Yet, agentic workflows that rely on large language models (LLMs) to author 3D programs remain brittle, often failing to translate high-level intent into consistent low-level geometry. We attribute this fragility to a mismatch between existing programmatic interfaces and the reasoning strengths of LLMs, which favor semantic structure and spatial relations over fragile numeric choices. In this paper, we jointly design an Agent-centric Domain-Specific Language (aDSL) and a role-specialized multi-agent system to close this gap. aDSL bridges semantic logic and geometric constraints by emphasizing composability and spatial reasoning; it enables agents to manipulate geometry through relational operators instead of brittle absolute coordinates. Building on aDSL, our training-free multi-agent system follows a Plan-Execute-Critic loop to decompose requests, synthesize code, and iteratively repair errors and constraint violations using execution feedback. Experiments show that this co-design improves robustness, controllability, and faithfulness to user intent. Our method outperforms prior LLM-based baselines on text-to-shape and image-to-shape tasks while preserving explicit structure, editability, and interpretability. It also enables downstream applications such as articulated object creation and structured scene composition. Our code is available at https://github.com/sig-pku/aDSL.

Rui-Huan Wang, Si-Tong Wei, Jia-Qi He et al. · 0 citations

A Multiagent Large Language Model–Based System for Early-Stage Building Layout Planning

A multiagent large language model (LLM)–based system for early-stage building layout planning, which enables flexible design requirement inputs and robust spatial reasoning and demonstrated significant improvements in both geometric quality and semantic alignment over a baseline LLM-only system.

Haolan Zhang, Ruichuan Zhang · 0 citations
Preprint Aug 2026

PolyLayout: Hierarchical VLM-Guided Layout Generation Beyond Rectangular Rooms

Generating physically plausible 3D room layouts is essential for home furnishing retail, enabling customers to visualize products in their own homes and confidently make purchasing decisions. However, a gap exists between academic research and real-world application: existing solutions primarily focus on algorithmic strategies for furniture placement, largely neglecting the non-rectangular geometries and strict door/window constraints prevalent in real homes. To bridge the gap, we introduce a hybrid, hierarchical framework tailored for retail, specifically designed to support scalable spatial planning applications. Our system decouples generation into three stages: (1) functional furniture clustering and fine-grained intra-zone placement; (2) macro-routing guided by a vision-language model (VLM) to anchor both these clustered zones and any remaining standalone furniture within diverse polygonal boundaries; and (3) rule-based optimization for collision-free micro-arrangements that respect architectural constraints. We evaluate our system on production-scale catalogs and a representative set of irregular real-world topologies. Our results show that our approach attains the highest perceptual plausibility while maintaining good geometric compliance at relatively low latency, and extends to irregular boundaries that existing methods do not natively support.

Yutong Jiang, Zahra Atashgahi, Carlos Soto Garcia Delgado et al. · 0 citations
Open access Aug 2026

PeopleFlow: a reproducible geometry-aware multi-agent framework for evacuation safety evaluation across diversified building environments

Evaluating evacuation performance across building types requires methods that capture how spatial layout, pedestrian behavior, and operational disruptions interact under stress. Static compliance checks do not address this need, and most existing simulation tools require manual geometry preparation with limited support for reproducible cross-layout comparison. This paper introduces PeopleFlow, a geometry-aware multi-agent framework that automatically converts architectural floor plans into simulation environments and applies force-driven pedestrian dynamics with congestion-aware routing. A structured evaluation across 450 core simulations spanning nine layout types and five operational conditions reveals a 7.94-fold range in clearance time, driven primarily by geometric topology and routing policy rather than behavioral parameters alone. A further 210 supplementary runs confirm generalization to real-world floor plans; consistency checks against published evacuation drill ranges show full band overlap with a mean midpoint deviation of 0.83 s. The primary contribution is a reproducible comparative pipeline that couples automated floor-plan ingestion, scenario-controlled simulation, and artifact-backed reporting, giving architects, safety engineers, and digital-twin practitioners a systematic basis for identifying and prioritizing safer design alternatives.

Likith Sai Kunchi, Manivannan Thulasirangan Lakshmidevi, K. S. K. Karthik Reddy · 0 citations
Review Aug 2026

Roomer: Reflective Object-Grounded Model Editing and Repair for 3D Indoor Layout Synthesis

Existing indoor layout generators produce globally plausible layouts yet may retain local violations such as collisions, out-of-bounds placements, obstructed openings, and blocked circulation. Most prior work focuses on full-scene synthesis or scene-level optimization, with limited support for identifying responsible objects and locally repairing affected regions. We present Roomer, a reflective repair framework that casts these violations as sparse, object-grounded repair problems. Roomer encodes layouts as ``RoState''and uses ``RoReview''to bind measured violations to implicated objects. A geometry-conditioned vision-language model planner proposes a structured local edit, while a deterministic solver validates it and generates a finite set of candidate edits when needed. Each candidate is committed only if full-scene verification confirms that it resolves the target violation without new hard violations or broken protected constraints. We train the planner on Roomer-CC, a controlled-corruption dataset that pairs faulty layouts with object-grounded violation evidence and known-feasible inverse StatePatches. Since existing benchmarks rarely assess whether physically valid layouts are usable, we introduce Roomer-Eval to assess distributional quality, physical validity, and practical usability. Experiments show that Roomer repairs residual violations while preserving valid regions, improves physical validity and usability, and transfers across external generators.

Lingwei Dang, Ziyan Qiu, Jiajia Cheng et al. · 0 citations
Book Open access Jul 2026

Multi-Agent CAD Code Generation

Advances in large language models (LLMs) have sparked interest in automating parametric CAD modeling through natural language. Existing LLM-based approaches often treat CAD modeling as flat text generation, overlooking the hierarchical structure and geometric constraints inherent in CAD programs. We present CAD-Factory, a Text-to-CAD generation system for language-driven CAD modeling that explicitly models the structural and parametric semantics of CAD programs. Our core contribution is a new formulation of CAD generation as structured program synthesis, coupled with a learnable hierarchical CAD program representation that disentangles structural topology from parameter instantiation. Building on this formulation, CAD-Factory adopts a manager–programmer–reviewer architecture: a planning agent infers program hierarchy, a coding agent instantiates symbolic and numerical parameters, and an evaluation module enforces structural validity and geometric feasibility, which supports structure-aware reasoning, constraint-consistent generation, and interpretable program synthesis. An editor–viewer loop further enables part-aware code refinement through visual feedback, supporting iterative and controllable design workflows. We also contribute a process-oriented annotation pipeline and a Text–CAD dataset with parameter-free or partially specified descriptions that reflect real-world design expression. Extensive experiments demonstrate that CAD-Factory significantly improves structural correctness and geometric consistency across diverse CAD code generation and editing tasks, establishing a structured, interpretable, and robust framework for AI-assisted design.

Yang Liu, Daxuan Ren, Yijie Ding et al. · 0 citations