Roomer is presented, a reflective repair framework that casts local violations as sparse, object-grounded repair problems and repairs residual violations while preserving valid regions, improves physical validity and usability, and transfers across external generators.
Abstract
Existing indoor layout generators produce globally plausible layouts yet may retain local violations such as collisions, out-of-bounds placements, obstructed openings, and blocked circulation. Most prior work focuses on full-scene synthesis or scene-level optimization, with limited support for identifying responsible objects and locally repairing affected regions. We present Roomer, a reflective repair framework that casts these violations as sparse, object-grounded repair problems. Roomer encodes layouts as ``RoState''and uses ``RoReview''to bind measured violations to implicated objects. A geometry-conditioned vision-language model planner proposes a structured local edit, while a deterministic solver validates it and generates a finite set of candidate edits when needed. Each candidate is committed only if full-scene verification confirms that it resolves the target violation without new hard violations or broken protected constraints. We train the planner on Roomer-CC, a controlled-corruption dataset that pairs faulty layouts with object-grounded violation evidence and known-feasible inverse StatePatches. Since existing benchmarks rarely assess whether physically valid layouts are usable, we introduce Roomer-Eval to assess distributional quality, physical validity, and practical usability. Experiments show that Roomer repairs residual violations while preserving valid regions, improves physical validity and usability, and transfers across external generators.
By combining HRAP with RMR, ScenePilot offers an efficient alternative to one-shot generation and heavy full-scene optimization, improving physical plausibility, functional coherence, and controllability while preserving diversity.
Jiawei Zhang, Hong-Song Wang, Pan Zhou· 0 citations
This work presents a graph-based intermediate representation that separates semantic coherence from physical feasibility, together with a hybrid search-and-refinement strategy that moves layout generation beyond local relational modeling and initialization-sensitive optimization toward globally consistent reasoning and...
Jia-Lu Huang, Yingxuan You, Fei Wang et al.· 0 citations
This paper proposes a top-down framework for synthesizing hierarchical 3D scene graphs, including a room layer -- describing the floor plan and traversability -- and an object layer modeling object layouts within each room, and proposes a novel mixed-domain graph diffusion model jointly predicting room categories, floo...
Siyi Hu, Jared Strader, Hyungtae Lim et al.· arXiv.org· 0 citations
Agentic Designer is proposed, a progressive, multi-agent framework that formulates structure-aware interior layout generation as an iterative and constraint-verified decision process and significantly outperforms state-of-the-art methods, demonstrating substantial improvements in strict structural adherence and functio...
Zhijing Yang, Hao-Cheng Lin, Zhihua Xu et al.· IEEE Transactions on Pattern...· 1 citation
Function-Room Generation is introduced, a new indoor 3D scene generation setting that creates rooms supporting explicit functional goals rather than merely visually plausible layouts, and ScenePRM, an execution-grounded process reward framework that improves the expert through reinforcement learning with functional, ge...
Hao Feng, Zhi Zuo, Ming-Jian Liang et al.· 1 citation
A framework that predicts an executable scene representation from sparse views and realizes it through perception-grounded asset instantiation and closed-loop spatial refinement is presented, and observation-consistent supervision is introduced that aligns each target scene with the visual evidence available in its inp...
Kai Li, Lu-Tao Jiang, Zhenyang Li et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.