search

rotemtzaban / STIT

MIT License
1.2k stars 170 forks source link

mouth_open seems to be invalid #14

Open c1a1o1 opened 2 years ago

c1a1o1 commented 2 years ago

mouth_open seems to be invalid

rotemtzaban commented 2 years ago

@c1a1o1 Hi, Sorry for the late reply. From my experiments with the mouth_open direction it seems to work, though it does need a very high strength parameter(around 25-30 worked for me). Additionally, it is also possible to perform this edit using StyleCLIP, which might get better results. For me the following command worked well:

python edit_video_stitching_tuning.py --input_folder videos/datasets/obama/ \
--output_folder edits/obama \
--run_name obama \
--edit_name mouth_open_styleclip \
--edit_type styleclip_global \
--target_class 'Face with open mouth' \
--edit_range 3 3 1 \
--beta 0.15 \
--border_loss_threshold 0.005
c1a1o1 commented 2 years ago

Thanks! I would like to know how to test the opening and closing degree of the mouth from the input face