Codes with pretrained models and binarized datasets

We release the pre-trained models of GeneFace:

• lrs3.zip includes the models trained on LRS3-ted dataset (a lm3d_vae to perform the audio2motion transform and a syncnet for measuring the lip-sync), which are generic for all possible target person videos.
• May.zip includes the models trained on the May.mp4 target person video (a postnet for refining the predicted 3d landmark, a lm3d_nerf for rendering the head image, and a lm3d_nerf_torso for rendering the torso part). For each target person video, you need to train these three models.
• How to use the pretrained models: unzip the lrs3.zip and May.zip into the checkpoints directory, then follow the commandlines for inference in README.md

🔥 We also release the binarized datasets:

• LRS3-TED: We provide the processed lrs3 dataset on Google Drive. Download link: Part1, Part2.
• May: We provide the processed NeRF dataset for the video May.mp4 on Google Drive at this link, which is required for inference the NeRF-based renderer in our quick start guide.