diffusers.FluxPipeline has no .from_single_file() function

lutusp commented 1 month ago

Describe the bug

At the moment one cannot use a local Flux1-dev or -schnell file for lack of an essential function "from_single_file()" in the diffusers.FluxPipeline library. The provided flag "local_files_only" for some reason doesn't solve this problem.

Reproduction

pipe = FluxPipeline.from_single_file(
    'full path to local file, example /(full_path)/flux1-dev.safetensors',
    torch_dtype=torch.bfloat16,
    use_safetensors=True,
    local_files_only=True
    )

Logs

No response

System Info

$ diffusers-cli env

🤗 Diffusers version: 0.30.0.dev0
Platform: Linux-5.15.0-113-generic-x86_64-with-glibc2.35
Running on Google Colab?: No
Python version: 3.10.12
PyTorch version (GPU?): 2.2.2+cu121 (True)
Flax version (CPU?/GPU?/TPU?): not installed (NA)
Jax version: not installed
JaxLib version: not installed
Huggingface_hub version: 0.24.5
Transformers version: 4.41.1
Accelerate version: 0.30.1
PEFT version: not installed
Bitsandbytes version: not installed
Safetensors version: 0.4.3
xFormers version: 0.0.25.post1
Accelerator: NVIDIA GeForce RTX 4090, 24564 MiB
Using GPU in script?: YES
Using distributed or parallel set-up in script?: NO

Who can help?

No response

DN6 commented 1 month ago

@lutusp Are you trying to load just the transformer model or do you have the weights for the entire checkpoint saved in a single file checkpoint?

lutusp commented 1 month ago

I guess my explanation wasn't clear enough. My point wasn't that the function created an unexpected outcome, it is that the function doesn't exist. There is no function with that name in diffusers.FluxPipeline.

But apart from that, it was this file: "flux1-dev.safetensors", from here: https://huggingface.co/black-forest-labs/FLUX.1-dev/tree/main .

mlick commented 1 month ago

I have a same question, i want to know how to load local model?

DN6 commented 4 weeks ago

@lutusp Support for single file for Flux at the pipeline level hasn't been added yet because checkpoints that contain all the model components in a single file were only recently released. The checkpoint you shared contains just the transformer weights.

Support for single file loading just the Transformer exists currently.

transformer = FluxTransformer2DModel.from_single_file(
    "https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/flux1-dev.safetensors",
    torch_dtype=torch.bfloat16
).to("cuda")
pipe = FluxPipeline.from_pretrained(
    "black-forest-labs/FLUX.1-dev",
    transformer=transformer,
    torch_dtype=torch.bfloat16
)

tomsin9 commented 3 weeks ago

for the FluxTransformer2DModel.from_single_file(), when i change the path to local, it doesnt work:

OSError: runwayml/stable-diffusion-v1-5 does not appear to have a file named config.json.

sxy771 commented 1 week ago

for the FluxTransformer2DModel.from_single_file(), when i change the path to local, it doesnt work:

OSError: runwayml/stable-diffusion-v1-5 does not appear to have a file named config.json.

I'm also wondering how to handle above errors.

I tried to load flux model downloaded from civitai but the model didn't work showing OSError message.

huggingface / diffusers