search

williamyang1991 / FRESCO

[CVPR 2024] FRESCO: Spatial-Temporal Correspondence for Zero-Shot Video Translation
https://www.mmlab-ntu.com/project/fresco/
Other
736 stars 72 forks source link

I have a 1.5 model .safetensor file downloaded from civitai. How to use it? #18

Open davidliudev opened 8 months ago

davidliudev commented 8 months ago

I have a 1.5 model .safetensor file downloaded from civitai. How to use it? I tried to change the sd_model to include path to the file but it complains that it cannot find model_index.json

williamyang1991 commented 8 months ago

The way of loading safetensor is different from https://github.com/williamyang1991/FRESCO/blob/9fe1be71b6c21890b5bc92659026f9586440266e/run_fresco.py#L76

pipe = StableDiffusionPipeline.from_pretrained("./model/sd1.5/")

You can try the following two ways

pipe = StableDiffusionPipeline.from_pretrained("./model/sd1.5.safetensors", use_safetensors=True)
pipe = StableDiffusionPipeline.from_single_file("./model/sd1.5.safetensors")
davidliudev commented 8 months ago

Thanks. Will try

lengthtail commented 7 months ago

@williamyang1991 I believe that many people would like to use FRESCO on their own locally stored models more easily. I have made a related pull request, please check it out. https://github.com/williamyang1991/FRESCO/pull/42