We present PhysBrain 1.5, a unified model for understanding physical environments, generating actions, and predicting future states. Motivated by the physical loop of observation, interaction, and environmental change, we bring these capabilities into a common learning framework. Starting from a general vision--language model, we encode language responses, end-effector motion, and dense visual targets as discrete sequences and jointly optimize them with autoregressive next-token prediction. Pre-training draws its embodied supervision entirely from human interaction videos, using task-centered episodes to pair semantic and spatial context with recovered motion and subsequent observations. We then adapt the model through supervised fine-tuning on a mixture of human demonstrations, robot trajectories, and simulated experience. Across 28 embodied understanding benchmarks, our 8B model achieves an average score of 72.5, setting a new open-source state of the art and performing on par with leading proprietary models such as GPT-6-Astra and Gemini 3.6 Flash. It achieves the best open-source results on 14 benchmarks while retaining general multimodal capabilities. Beyond these understanding evaluations, qualitative examples show the model's ability to produce end-effector trajectories and predict future scenes through spatially aligned RGB, depth, and robot-mask outputs.
DeepCybo Team, Yue Bin, Hai-Peng Cao et al.· 0 citations
Developing universal positioning, navigation, and timing (PNT) remains an enduring pursuit. Today’s complex environments call for PNT systems that are more resilient, energy-efficient, and cognitively capable as human beings. As a conceptual and preliminary exploration, this paper tentatively explores how unmanned systems could potentially integrate brain-inspired spatial cognition with the high precision of traditional navigation. We offer an exploratory perspective and preliminary roadmap for the envisioned transition of PNT from ‘tool-oriented’ to ‘cognition-driven’ paradigms. Our exploratory contributions encompass: (1) a multi-level analysis of differences among traditional navigation, biological brain navigation, and brain-inspired navigation (BIN); (2) a preliminary fusion framework that integrates key elements of traditional and BIN approaches; and (3) forward-looking recommendations for the future development of BIN. This work does not purport to present a complete, experimentally validated navigation system. Additional resources can be available at: https://github.com/BINUCOE/Exploration_for_Conjunction_Different_PNT.
Xu He, Xiangdong An, Xiao-Lin Meng et al.· Neuromorphic Computing and E...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.