General-purpose reward models are increasingly the bottleneck for scaling robot learning, yet the recipe for learning value-related capabilities from large-scale heterogeneous corpora remains underexplored. Existing approaches tie supervision to task-internal anchors such as preferences or normalized progress, none of...
Dongchi Huang, Hong-Yin Zhang, Bo-Han Hou et al.· 7 citations
A confidence-aware multimodal fusion framework (CAMF) is proposed to realize reliable human intention prediction for industrial human-robot collaboration and outperforms existing multimodal fusion approaches in overall performance and stability.
Xin-Yu Liu, Qing-Qing Dong, Bo Jia et al.· 0 citations
A set of heuristics are defined to iteratively adapt the support in tandem with posterior inference inlihood-free inference and show that this increases the reliability of both parameter inference and agent skill adaptation.
Georgios Kamaras, Craig Innes, S. Ramamoorthy· IEEE Transactions on Automat...· 0 citations
Results show that agents learn increasingly stable and effective behaviors over time, as demonstrated by converging loss trends, improved reward signals, and more consistent navigation patterns such as fire-boundary tracking.
Caden Chandra, Jerry Ng· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
We identify a diagonal saturation principle in modal inverse problems: when truncation noise is isotropic, the Bayes-optimal Tikhonov shape is a closed-form power law Gamma_k proportional to lambda_k^|s| set by the prior alone, independent of the domain. Berry's random-wave conjecture decorrelates the truncation noise...
The results demonstrate that compact target-centric representations can support robust long-horizon aerial visual servoing and that visual curriculum training can improve robustness to dynamic distribution shifts despite limited gains in nominal performance.
Soft Actor-Critic (SAC) represents a continuous policy as an unbounded Gaussian that is squashed by tanh. The Jacobian of that map is $\partial a/\partial u = 1-a^2$, which vanishes as $|a|\to 1$. A natural concern is that this throttle starves the actor of critic signal exactly where extreme actions (full brake, full...
This study investigates developmental mechanisms that enable small, resource-constrained systems such as cm-sized millirobots to autonomously explore, learn, and adapt their capabilities throughout their lifespan through the interplay of the proposed tiny Developmental Skill Method (tinyDSM).
Markus Kobelrausch, Michael Miedler, A. Jantsch· IEEE Transactions on Cogniti...· 0 citations
FiberTune is proposed, a training-time objective that preserves teacher-structured visual residuals without adding inference-time overhead and improves over task-loss-only fine-tuning in every one of six controlled simulation settings spanning two benchmarks and two architectures.
Haihao Lin, Xiang-Sheng Huang, Xiao Yang et al.· arXiv.org· 2 citations
Tactile memory, the ability to store and retrieve touch-based experience, is critical for contact-rich tasks such as key insertion under uncertainty. To replicate this capability, we introduce Tactile Memory with Soft Robot (TaMeSo-bot), a system that integrates a soft wrist with tactile retrieval-based control to enab...
Tatsuya Kamijo, Mai Nishimura, Nodoka Shibasaki et al.· 0 citations
It is shown how Predictive State Representations learn POMDP matrices up to a similarity transform, and this transform may be estimated via tensor decomposition methods, and it is shown that learning a POMDP beyond a partition of states is impossible from sequential data.
Seiji Shaw, Travis Manderson, Chad Kessens et al.· arXiv.org· 1 citation
GLiBRL, a deep Bayesian RL framework that combines generalised linear task models with learnable non-linear basis functions, features conjugate Bayesian inference, yielding exact, sequential posterior updates over task parameters and model noise, together with a closed-form marginal likelihood that eliminates variation...
A new system identifies and corrects unreliable object descriptions stored in a robot’s memory, improving the robot’s ability to interact with its environment.
Robots are getting smarter, but how can their hardware match that growth? New Microsoft Research findings show that moving AI inference beyond the robot can improve task success, boost efficiency, and support more advanced physical AI workloads. The post Offloaded inference for real-world physical AI robotics appeared first on Microsoft Research.