maszhongming / Multi-LoRA-Composition

Repository for the Paper "Multi-LoRA Composition for Image Generation"
425 stars 45 forks source link

how? #3

Closed zachysaur closed 5 months ago

zachysaur commented 6 months ago

how can you add your own character and clothing lora

maszhongming commented 6 months ago

https://github.com/maszhongming/Multi-LoRA-Composition/blob/8321b9084d260ab927a42971d95afe1fcf7bf806/example.py#L40

You can modify the lora_path and weight_name during the initialization of LoRA to load your own LoRA weights.

zachysaur commented 6 months ago

this need to be from huggingface or you can just directly upload lora file

maszhongming commented 6 months ago

Both are possible. LoRA can be sourced from Hugging Face or your local files.

zachysaur commented 6 months ago

so downloading and generating pictures only required creating envirement running requirements putting model in checking point and use it?

maszhongming commented 6 months ago

The workflow, as described in the README, is:

  1. Select a specific stable diffusion model.
  2. Initialize LoRAs, which can be loaded from Hugging Face or from your local files.
  3. Choose the method you want to use ("merge", "switch", "composite").
  4. Provide the text prompts for the images you want to generate.
  5. Generate the images.

Overall, the input consists of several LoRAs and prompts, without downloading images.