Adds a tab to the webui that allows the user to automatically extract keyframes from video, and manually extract 512x512 crops of those frames for use in model training.
- Install AUTOMATIC1111's Stable Diffusion Webui
- Install ffmpeg for your operating system
- Clone this repository into the
extensionsfolder inside the webui
Make sure you don't already have python-ffmpeg installed globally, as the library this program uses is ffmpeg-python, and your installation will conflict with it.
- Drop videos you want to extract cropped frames from into the
training-picker/videosfolder - Open up the Training Picker tab of the webui
- Select one of the videos you placed in the
training-picker/videosfolder from the dropdown on the left - Click 'Extract Frames`
- After the extraction finishes, a new keyframe set for the video should be selectable in the dropdown on the right
- Select the keyframe set, and the frames will appear in the browser below
Optionally, you can also just supply a large collection of individual images you would like to work with directly by placing them into a folder within training-picker/extracted-frames.
- Scroll up and down to increase or decrease the size of the crop brush
- Ctrl+scroll to adjust the aspect ratio of the crop, and middle-click to reset the aspect ratio to 1:1
- Shift+scroll to adjust the size / aspect ratio by smaller increments
- Click to save a crop at the brush's position
- Navigate between frames in the collection by clicking the navigation buttons, entering a number into the counter, or by using the arrow keys / AD
- Select an outfill method to outfill the non-square area of a rectangular crop into a square shape
- Click "Bulk process frames with chosen outfill method" to automatically process every image in the current frame set using the outfill method chosen, outputting to the directory under "Save crops to:"
- Crops will be saved to
training-picker/cropped-framesby default