Enhance 3D Gaussian splatting for dynamic scenes: integrating semantic and geometric consistency

Abstract

3D Gaussian splatting (3DGS) provides an efficient and expressive scene representation by jointly modeling spatial geometry and appearance, which has led to significant advances in high-fidelity scene reconstruction and novel view synthesis. However, in real-world environments, occlusions from pedestrians or equipment often introduce blurriness, artifacts, and geometric distortions. To address these challenges, this paper proposes a robust 3DGS modeling method enhanced by semantic and geometric consistency. First, the self-supervised foundation model DINOv2 is utilized to extract high-dimensional semantic features, leveraging its superior generalization capabilities to assist in identifying potential dynamic regions. Second, monocular depth estimation and a depth residual mechanism are introduced to construct geometric consistency constraints, enabling the precise localization of areas that violate static assumptions. Finally, a progressive guided probability masking mechanism is designed; it employs an adaptive sigmoid function to achieve a ‘coarse-to-fine’ soft-constraint optimization, effectively mitigating the training instability inherent in traditional binary hard masks. Experimental results on the neural radiance fields (NeRF)-on-the-go, RobustNeRF, and self-collected datasets demonstrate that the proposed method effectively suppresses dynamic artifacts and improves reconstruction quality. The proposed approach achieves competitive or superior performance compared with 3DGS, SpotLessSplats, T-3DGS, and RobustSplat on standard image-quality metrics, including peak signal-to-noise ratio, structural similarity index measure, and learned perceptual image patch similarity.