search

yoyo-nb / Thin-Plate-Spline-Motion-Model

[CVPR 2022] Thin-Plate Spline Motion Model for Image Animation.
MIT License
3.39k stars 555 forks source link

Training Tutorial? #24

Open holycowdude opened 2 years ago

holycowdude commented 2 years ago

Would anyone be so kind as to provide a tutorial to create and train your own dataset for Thin Plate Splin Motion Model please?

yoyo-nb commented 2 years ago

The dataset format is the same as FOMM. You can refer to FOMM's README to build your own dataset.

Training on your own dataset

    1. Resize all the videos to the same size e.g 256x256, the videos can be in '.gif', '.mp4' or folder with images. We recommend the later, for each video make a separate folder with all the frames in '.png' format. This format is loss-less, and it has better i/o performance.
    1. Create a folder data/dataset_name with 2 subfolders train and test, put training videos in the train and testing in the test.
    1. Create a config config/dataset_name.yaml, in dataset_params specify the root dir the root_dir: data/dataset_name. Also adjust the number of epoch in train_params.