DragVideo: Interactive Drag-style Video Editing

Yufan Deng    Ruida Wang    Yuhao Zhang    Yu-Wing Tai    Chi-Keung Tang

Updates

• [2024/09/25] Code released at branch release
• [2024/07/04] Accepted by ECCV2024

Quick Start

1. Setup environment

conda env create -f environment.yaml
conda activate dragvideo

2. Download weights

cd pips
sh get_reference_model.sh
cd ..

3. Start the UI

python drag_ui.py

4. Currently, the UI only supports square video input. Videos we used can be downloaded at Google Drive.

UI Demo

UIdemo.mp4

BibTeX

@article{deng2023dragvideo,
      title={Dragvideo: Interactive drag-style video editing},
      author={Deng, Yufan and Wang, Ruida and Zhang, Yuhao and Tai, Yu-Wing and Tang, Chi-Keung},
      journal={arXiv preprint arXiv:2312.02216},
      year={2023}
      }

Acknowledgements

Folder ./AnimateDiff is from AnimateDiff
Folder ./pips is from pips
Folder ./TrackAnything is from Track-Anything
DragVideo codebase built upon DragDiffusion