MotionGS: Exploring Explicit Motion Guidance for Deformable 3D Gaussian Splatting

Ruijie Zhu*, Yanzhe Liang*, Hanzhi Chang, Jiacheng Deng, Jiahao Lu,
Wenfei Yang, Tianzhu Zhang, Yongdong Zhang
*Equal Contribution.
University of Science and Technology of China
NeurIPS 2024

                 

The overall architecture of MotionGS. It can be viewed as two data streams: (1) The 2D data stream utilizes the optical flow decoupling module to obtain the motion flow as the 2D motion prior; (2) The 3D data stream involves the deformation and transformation of Gaussians to render the image for the next frame. During training, we alternately optimize 3DGS and camera poses through the camera pose refinement module.

TODO

• Release the video demo
• Release the MotionGS code (Full code might be released after the CVPR deadline, stay tuned!)

Bibtex

If you find our work useful in your research, please consider citing:

@article{zhu2024motiongs,
  title={MotionGS: Exploring Explicit Motion Guidance for Deformable 3D Gaussian Splatting},
  author={Zhu, Ruijie and Liang, Yanzhe and Chang, Hanzhi and Deng, Jiacheng and Lu, Jiahao and Yang, Wenfei and Zhang, Tianzhu and Zhang, Yongdong},
  journal={arXiv preprint arXiv:2410.07707},
  year={2024}
}