Oct 2026· Proceedings of the 28th International Conference On Multimodal Interaction· 0 citations· 19 references
Abstract
Authoring and refining presentation slides is time-consuming in academic and professional settings. Although generative AI lowers the barrier to creating initial drafts, its black-box, one-way workflow often limits fine-grained control. A formative study with 10 frequent presentation authors identified trial-and-error anxiety, invisible intermediate decisions, cross-slide inconsistency, ambiguous spatial references, and fear of irreversible edits. We present ECHO, an interactive slide-refinement system that combines natural-language instructions with direct visual selection. ECHO translates multimodal intent into schema-constrained operation plans through a Plan-Confirm-Execute loop, maintains global style and user habit memory, routes spatially ambiguous requests to a vision-language model, and supports byte-exact rollback. We further introduce CoEdit-Eval, a multi-level framework for evaluating intent mapping, spatial grounding, execution safety, and rendered visual quality. Across four foundation models, ECHO raises Target Hit@1 from 0% for text-only baselines to 55–85%. A within-subjects study with 14 participants shows a 25.8% reduction in completion time and a 20.8% reduction in NASA-TLX workload. These results demonstrate how explicit execution boundaries can make AI-assisted document refinement more controllable, transparent, and reversible.
ReDeck is proposed, a step-level render-grounded refinement framework that decomposes slide revision into atomic edit actions and returns renderer-derived observations after each step, turning refinement into"one edit, one observation."
Mu-Zhao Tian, Ze-Zi Zeng, Yi-Fan Yang et al.· 0 citations
This work provides a practical and extensible methodology for enhancing the predictability and control of state-of-the-art video generation models, moving the field beyond speculative curiosities toward reliable, production-ready tools.
Aman Tyagi, Hemanth Boinpally, Jonathan Chen et al.· 1 citation
This work introduces PROS (Proactive Refinement Of Scientific Posters), which separates epistemic initiative from behavioral authority: the system can surface source-grounded candidate problems, while users decide which become repair goals and whether resulting changes are committed.
Xingda Lyu, Hong-Ling Lu, Xin-ye Luo et al.· 0 citations
Commercial design platforms increasingly edit documents through large language model (LLM) agents, but two practical problems block reliable deployment: legacy document formats expose only \emph{flat}, absolutely positioned elements, so agents must recompute coordinates and routinely break layouts; and design has no un...
Jooyoung Jang, Taegyeong Lee, Jihyeon Park et al.· 0 citations
BranchVis is presented, a prototype that represents prompts and generated images as nodes in a tree-based visualization, enabling direct navigation, unambiguous revisitation, integrated comparison, and management of complex histories.
Rifat Mehreen Amin, Alexander Nuss, M. Dutoit et al.· Proceedings of the 14th Nord...· 0 citations
Results support the Tool-Call Scaffold Hypothesis: in current thinking-with-images distributions, the active signal is the structured text emitted at tool-call time; the returned image is a redundant carrier.
Jiahao Shao, Yuanbo Yang, Yi-Yi Liao et al.· 3 citations
Enforcing physics-based constraints prevents AI models from generating unreliable predictions for complex nonlinear systems in weather, climate, and turbulent flows.
MIT News · Artificial Intelligence· news.mit.eduNov 20, 2026
An MIT and Dana-Farber Institute-led team used large language models to examine nearly 4,000 studies and hundreds of code repositories, revealing gaps in the information needed to scrutinize and reuse published research.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.