Neural Radiance Field Dynamic Scene SLAM Based on Ray Segmentation and Bundle Adjustment


This is an early access version, the complete PDF, HTML, and XML versions will be available soon.

Article

by

Yuquan Zhang

1,2 and

Guosheng Feng

1,*

1

School of Traffic and Transportation, Shijiazhuang Tiedao University, Shijiazhuang 050043, China

2

Department of Automotive Engineering, Hebei Jiaotong Vocational and Tecenical College, Shijiazhuang 050035, China

*

Author to whom correspondence should be addressed.

Sensors 2025, 25(6), 1679; https://doi.org/10.3390/s25061679 (registering DOI)

Submission received: 25 January 2025
/
Revised: 5 March 2025
/
Accepted: 6 March 2025
/
Published: 8 March 2025

Abstract

The current neural implicit SLAM methods have demonstrated excellent performance in reconstructing ideal static 3D scenes. However, it remains a significant challenge for these methods to handle real scenes with drastic changes in lighting conditions and dynamic environments. This paper proposes a neural implicit SLAM method that effectively deals with dynamic scenes. We employ a keyframe selection and tracking switching approach based on Lucas–Kanade (LK) optical flow, which serves as prior construction for the Conditional Random Fields potential function. This forms a semantic-based joint estimation method for dynamic and static pixels and constructs corresponding loss functions to impose constraints on dynamic scenes. We conduct experiments on various dynamic and challenging scene datasets, including TUM RGB-D, Openloris, and Bonn. The results demonstrate that our method significantly outperforms existing neural implicit SLAM systems in terms of reconstruction quality and tracking accuracy.



Source link

Yuquan Zhang www.mdpi.com