smthemex / ComfyUI_FoleyCrafter

FoleyCrafter is a video-to-audio generation framework which can produce realistic sound effects semantically relevant and synchronized with videos.
Apache License 2.0
43 stars 6 forks source link

auffusion safetensors / bin error #2

Open specblades opened 2 months ago

specblades commented 2 months ago

Got that error

An error occurred while trying to fetch S:/ComfyUImain/models/auffusion/auffusion-full-no-adapter: Error no file named diffusion_pytorch_model.safetensors found in directory S:/ComfyUImain/models/auffusion/auffusion-full-no-adapter.

But there is no model in sft format, only bin. image

specblades commented 2 months ago

Also i got this image_encoder is not loaded since image_encoder_folder=None passed. You will not be able to use ip_adapter_image when calling the pipeline with IP-Adapter.Use ip_adapter_image_embeds to pass pre-generated image embedding instead.

smthemex commented 2 months ago

Also i got this image_encoder is not loaded since image_encoder_folder=None passed. You will not be able to use ip_adapter_image when calling the pipeline with IP-Adapter.Use ip_adapter_image_embeds to pass pre-generated image embedding instead.

this issues is not a error,Please ignore it, it takes a long time to load for the first time, please be patient and wait。

specblades commented 2 months ago

I got it, thank you!

I found that most of the pipeline is running on CPU. Any plans to rewrite it for GPU?

smthemex commented 2 months ago

if using GPU need 24G VRAM, and more... I close it