williamyang1991 / FRESCO

[CVPR 2024] FRESCO: Spatial-Temporal Correspondence for Zero-Shot Video Translation
https://www.mmlab-ntu.com/project/fresco/
Other
736 stars 72 forks source link

Which directory should the SD1.5 model be placed in? #5

Open jinwyp opened 8 months ago

jinwyp commented 8 months ago

Hi:

After run the script

python run_fresco.py ./config/config_music.yaml

But I didn't found any SD1.5 model in the project.

  1. Is it necessary to manually download the SD1.5 model?
  2. Which directory should the SD1.5 model be placed in?

BTW : the default path on windows 10 is C:\Users\xxxx\.cache\huggingface\hub

williamyang1991 commented 8 months ago

This line will automatically download the model from huggingface

https://github.com/williamyang1991/FRESCO/blob/c420080ac062eff7ef9634ef356d720330ce107f/run_fresco.py#L76

For details, please refer to https://huggingface.co/docs/diffusers/using-diffusers/loading

al3dv2 commented 8 months ago

@williamyang1991 It's doesn't download the models for me the ui works perfectly through, please where I place the models I can download them on huggingface manually

williamyang1991 commented 8 months ago

You just download it, for example, to ./model/runwayml/stable-diffusion-v1-5 Then you can sepcify config['sd_path']='./model/runwayml/stable-diffusion-v1-5' to load your local model

realyn commented 8 months ago

Is there a more convenient way to use local models in the future, such as setting and loading in the GUI interface?

davidliudev commented 8 months ago

This won't work with model downloaded from civitai, which normally is just a .safetensor file. any solution?