Video-Frame-Interpolation-Collections

A collection of state-of-the-art video frame interpolation (VFI) methods.
Contributors: Yihao Liu ([email protected])
✨ Suggestions and collaborations are welcomed~

Paper List

Learning-based methods

2021

• Revisiting Adaptive Convolutions for Video Frame Interpolation (WACV2021) [arXiv] [GitHub]
• Dual-Stream Fusion Network for Spatiotemporal Video Super-Resolution (WACV2021) [arXiv] [supp] [GitHub]
• Deep Animation Video Interpolation in the Wild (CVPR 2021) [paper] [supp] [GitHub]
• CDFI: Compression-Driven Network Design for Frame Interpolation (CVPR 2021) [arXiv] [GitHub]
• Multi-Level Adaptive Separable Convolution for Large-Motion Video Frame Interpolation (ICCV 2021) [paper]
• Time Lens: Event-Based Video Frame Interpolation (CVPR 2021) [paper] [supp] [GitHub]

2020

• RIFE: Real-Time Intermediate Flow Estimation for Video Frame Interpolation (arXiv2020) [arXiv] [GitHub]
• Space-Time Video Super-Resolution Using Temporal Profiles (ACM MM2020) [paper]
• Video Frame Interpolation without Temporal Priors (NeurIPS2020) [paper] [supp]
• Enhanced Quadratic Video Interpolation (ECCVW2020, winner of AIM2020 VTSR Challenge) [arXiv] [GitHub]
• BMBC:Bilateral Motion Estimation with Bilateral Cost Volume for Video Interpolation (ECCV2020) [arXiv] [GitHub]
• All at Once: Temporally Adaptive Multi-Frame Interpolation with Advanced Motion Modeling (ECCV2020) [arXiv]
• Softmax Splatting for Video Frame Interpolation (CVPR2020) [paper] [supp] [GitHub]
• Zooming Slow-Mo: Fast and Accurate One-Stage Space-Time Video Super-Resolution (CVPR2020, joint VFI and SR) [paper] [supp] [GitHub]
• AdaCoF: Adaptive Collaboration of Flows for Video Frame Interpolation (CVPR2020) [paper] [GitHub]
• FeatureFlow: Robust Video Interpolation via Structure-to-Texture Generation (CVPR2020) [paper] [supp] [GitHub]
• Blurry Video Frame Interpolation (CVPR2020) [paper] [GitHub]
• Scene-Adaptive Video Frame Interpolation via Meta-Learning (CVPR2020) [paper] [supp] [GitHub]
• FLAVR: Flow-Agnostic Video Representations for Fast Frame Interpolation (arXiv2020) [arXiv] [GitHub]
• Channel Attention Is All You Need for Video Frame Interpolation (AAAI 2020) [paper] [GitHub]
• FISR: Deep Joint Frame Interpolation and Super-Resolution with A Multi-scale Temporal Loss (AAAI 2020) [paper] [GitHub]

2019

• Quadratic Video Interpolation (NIPS2019, winner of AIM2019 VTSR Challenge) [paper] [supp] [project]
• Unsupervised Video Interpolation Using Cycle Consistency (ICCV2019) [paper] [supp] [project] [GitHub]
• Depth-Aware Video Frame Interpolation (CVPR2019) [paper] [supp] [GitHub]
• Deep Video Frame Interpolation Using Cyclic Frame Generation (AAAI2019) [paper] [GitHub]
• MEMC-Net: Motion Estimation and Motion Compensation Driven Neural Network for Video Interpolation and Enhancement (PAMI 2019) [arXiv] [project] [GitHub]

2018

• Context-Aware Synthesis for Video Frame Interpolation (CVPR2018) [paper]
• Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolation (CVPR2018) [paper] [supp] [GitHub]
• PhaseNet for Video Frame Interpolation (CVPR2018) [paper] [supp]

2017

• Video Frame Synthesis Using Deep Voxel Flow (ICCV2017) [paper] [supp] [GitHub]
• Video Frame Interpolation via Adaptive Separable Convolution (ICCV2017) [paper] [GitHub]
• Video Frame Interpolation via Adaptive Convolution (CVPR2017) [paper] [supp] [GitHub]

Related Challenges

• NTIRE 2021 Video Super-Resolution Challenge : Track 2 Spatio-Temporal (in conjunction with CVPR 2021)
  [NTIRE2021 website] [Challenge website] [Challenge report]
• AIM 2020 Challenge on Video Temporal Super-Resolution (in conjunction with ECCV 2020)
  [AIM2020 website] [Challenge website] [Challenge report]
• AIM 2019 Challenge on Video Temporal Super-Resolution (in conjunction with ICCV 2019)
  [AIM2019 website] [Challenge website] [Challenge report]