Image-stitching methods for moving elongated objects require high stitching quality, efficient inference, and robustness to interference from regions outside the target object. Existing methods still have difficulty satisfying these requirements simultaneously. This paper proposes a semi-supervised deep image-stitching method for moving elongated objects. The proposed framework consists of two stages: semi-supervised registration and unsupervised reconstruction. In the semi-supervised registration stage, a semi-supervised optical-flow estimation network is used to predict the bidirectional optical flow between the input images. An object-centric spatial transformation module is then introduced to remove regions outside the moving object and warp the inputs onto a unified plane. In the unsupervised reconstruction stage, a multi-scale fusion model is used to improve the quality of the reconstructed stitched image. Correspondingly, we design a reconstruction objective function based on multi-scale feature representations. To address the lack of available datasets for this task, we construct two datasets: MEOIS-D, a synthetic dataset for generalized evaluation, and Container-D, a real-world scene-specific dataset. Extensive comparative experiments and ablation studies demonstrate the effectiveness of the proposed method.
Xiao Lai, Zi-Qi Xie, Xianhui Liu· Italian National Conference...· 0 citations
Deep off-policy reinforcement learning algorithms for continuous control typically rely on neural value function approximation to guide policy improvement. However, temporal-difference (TD) learning introduces noisy targets, resulting in non-stationary optimization, while greedy policy updates amplify early-stage estimation errors. The recursive propagation of such errors leads to persistent overestimation bias and degraded training stability in actor-critic methods. Existing approaches attempt to alleviate this issue via prioritized sampling or modified value learning objectives, but often overemphasize high-uncertainty transitions caused by limited data coverage or bootstrapping errors, thereby further amplifying bias.In this paper, we propose Collaborative Weighting Actor-Critic (CWAC), a unified framework that explicitly accounts for predictive uncertainty in value estimation. CWAC employs distributional critic to model return uncertainty and introduces a collaborative weighting mechanism that jointly reweights TD-errors and uncertainty, enabling robust learning from reliable samples while suppressing noisy updates. In addition, we incorporate a stochastic pessimistic value estimation scheme via sampling from the return distribution, which effectively mitigates error propagation during policy improvement. CWAC can be seamlessly integrated into existing off-policy algorithm frameworks such as SAC, TD3, and DDPG with minimal overhead. Empirical results demonstrate that our proposed method significantly enhances performance across a diverse range of simulated tasks. Our code is publicly available at https://anonymous.4open.science/r/CWAC-348E.
Gong Gao, Xiao Lai, Zi-Qi Xie et al.· arXiv.org· 0 citations
Online reinforcement learning (RL) algorithms frequently exhibit poor sample efficiency and unstable learning dynamics, stemming from systematic critic estimation errors that are exacerbated by greedy policy updates. Existing behavior-prior reinforcement learning methods attempt to alleviate this issue by relying on offline pre-training to learn behavior models from fixed datasets and using policy priors to constrain online policy updates. However, the limited quality of offline datasets often hinders the ability to provide high-value policies that can effectively guide policy updates. The absence of expert trajectories significantly impairs online policy learning, leading to low sample efficiency and suboptimal performance. To address these challenges, we depart from conventional behavior prior approaches and propose a Bidirectional Behavior Prior Distillation (B2PD) algorithm. B2PD leverages action-value priors to guide a conditional variational autoencoder (CVAE) in generating a high-value behavior support set. The resulting expert behavior priors are further distilled into the agent, effectively reducing inefficient exploration and enabling stable policy optimization, while establishing a bidirectional knowledge flow mechanism. Empirical evaluations on both state- and pixel-based tasks verify that B2PD substantially improves sample efficiency while maintaining stable policy optimization. More broadly, this work shows that enforcing high-quality behavioral support during online learning effectively mitigates critic-induced error amplification, enabling structured behavior priors to guide policy updates in a principled and sample-efficient manner.
Gong Gao, Xiao Lai, Jia-Ji Shen et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
