not an issue - question on beta value

[johndpope]

I've been playing around with styleclip -

python edit_video_stitching_tuning.py --input_folder data/obama \
 --output_folder edits/obama/ \
 --run_name obama \
 --edit_type styleclip_global \
 --edit_name aids \
 --neutral_class "Face" \
 --target_class "Face with sores" \
 --beta 0.1 \ 
 --edit_range 10 10 1 \
 --outer_mask_dilation 50 \
 --start_frame 0 \
 --end_frame 100

changing the target class - ValueError: Beta value 0.15 is too high for mapping from Face to Face with sores, try setting it to a lower value

I have to bump it down to 0.1 for the program to run. But then the results seem indifferent to original video. Is there something obvious between the two? 'Face with sores' vs 'Face with lipstick'

also styleclip has global mappers which take > 10 hrs to build - but then they're fast for inference. https://github.com/orpatashnik/StyleCLIP

"mapper/pretrained/afro.pt": "https://drive.google.com/uc?id=1i5vAqo4z0I-Yon3FNft_YZOq7ClWayQJ",
"mapper/pretrained/angry.pt": "https://drive.google.com/uc?id=1g82HEH0jFDrcbCtn3M22gesWKfzWV_ma",
"mapper/pretrained/beyonce.pt": "https://drive.google.com/uc?id=1KJTc-h02LXs4zqCyo7pzCp0iWeO6T9fz",
"mapper/pretrained/bobcut.pt": "https://drive.google.com/uc?id=1IvyqjZzKS-vNdq_OhwapAcwrxgLAY8UF",
"mapper/pretrained/bowlcut.pt": "https://drive.google.com/uc?id=1xwdxI2YCewSt05dEHgkpmmzoauPjEnnZ",
"mapper/pretrained/curly_hair.pt": "https://drive.google.com/uc?id=1xZ7fFB12Ci6rUbUfaHPpo44xUFzpWQ6M",
"mapper/pretrained/depp.pt": "https://drive.google.com/uc?id=1FPiJkvFPG_y-bFanxLLP91wUKuy-l3IV",
"mapper/pretrained/hilary_clinton.pt": "https://drive.google.com/uc?id=1X7U2zj2lt0KFifIsTfOOzVZXqYyCWVll",
"mapper/pretrained/mohawk.pt": "https://drive.google.com/uc?id=1oMMPc8iQZ7dhyWavZ7VNWLwzf9aX4C09",
"mapper/pretrained/purple_hair.pt": "https://drive.google.com/uc?id=14H0CGXWxePrrKIYmZnDD2Ccs65EEww75",
"mapper/pretrained/surprised.pt": "https://drive.google.com/uc?id=1F-mPrhO-UeWrV1QYMZck63R43aLtPChI",
"mapper/pretrained/taylor_swift.pt": "https://drive.google.com/uc?id=10jHuHsKKJxuf3N0vgQbX_SMEQgFHDrZa",
"mapper/pretrained/trump.pt": "https://drive.google.com/uc?id=14v8D0uzy4tOyfBU3ca9T0AzTt3v-dNyh",
"mapper/pretrained/zuckerberg.pt": "https://drive.google.com/uc?id=1NjDcMUL8G-pO3i_9N6EPpQNXeMc3Ar1r",

"example_celebs.pt": "https://drive.google.com/uc?id=1VL3lP4avRhz75LxSza6jgDe-pHd2veQG"

Did you experiment using these ? It may shorten the time to render..... or is the time mostly on pti?

[rmokady]

Hi @johndpope, Our project demonstrate how to smoothly editing videos However, we use off-the-shelf editing techniques, such as StyleClip So the first question about "Face with sores" relate to StyleClip limitations

Regarding the StyleCLIP mappers, most of the time consuming on the PTI and Stitching, so it won'y change dramatically the running time. We have not experiment with these much, but I guess it will perform slightly worse, as global editing directions are expected to behave smoother.

[johndpope]

thx