Spotter is proposed, which reverses the roles: the embodied model leads and executes continuously, while the VLM runs in parallel, monitors through a lightweight local screener, intervenes only when an error is detected, reflects on and corrects it, and returns control.
Long Li, Qi-Chao Zhao, Yue Yang et al.· 0 citations
This hands-on problem-solving tutorial provides both a rigorous algorithmic and practical introduction to multi-turn RL finetuning for LLMs, and covers state-of-the-art multi-turn RL finetuning algorithms, turn-level vs. trajectory-level reward design, and production grade monitoring for reward hacking detection.
Zhe Wang, Sapana Chaudhary, Jiayu Li et al.· Proceedings of the 32nd ACM...· 0 citations
This work introduces a learnable control module trained via Group Relative Policy Optimization (GRPO) to determine the generation order and demonstrates that learning this control block substantially improves both text-to-image alignment and multimodal understanding in DLMs.
Yi-Dong Ouyang, Zhe Wang, Sourav S. Bhabesh et al.· arXiv.org· 0 citations
SD-MAR (Synthetic Data for Multi-image Analytical Reasoning) is introduced, a framework for training and evaluating VLMs on multi-image analytical reasoning that constructs paired visual scenarios through controlled perturbations and generates reasoning tasks spanning semantic change attribution and quantitative compar...
Shiyu Yuan, Sourav S. Bhabesh, Zhe Wang et al.· arXiv.org· 0 citations
Production large language model (LLM) based systems such as coding agents, web navigators, and tool-calling assistants operate over multiple turns of interaction with users, tools, and environments. Pretrained LLMs, depending on their size, can either underperform in these settings due to misalignment with the system's...
Zhe Wang, Sapana Chaudhary, Jiayu Li et al.· Proceedings of the 32nd ACM...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.