shivammehta25 / Matcha-TTS

[ICASSP 2024] 🍵 Matcha-TTS: A fast TTS architecture with conditional flow matching
https://shivammehta25.github.io/Matcha-TTS/
MIT License
751 stars 98 forks source link

Bump diffusers from 0.21.3 to 0.25.0 #37

Closed dependabot[bot] closed 10 months ago

dependabot[bot] commented 11 months ago

Bumps diffusers from 0.21.3 to 0.25.0.

Release notes

Sourced from diffusers's releases.

v0.25.0: aMUSEd, 3x faster SDXL, interruptable pipelines

aMUSEd

collage_full

aMUSEd is a lightweight text to image model based off of the MUSE architecture. aMUSEd is particularly useful in applications that require a lightweight and fast model, such as generating many images quickly at once. aMUSEd is currently a research release.

aMUSEd is a VQVAE token-based transformer that can generate an image in fewer forward passes than many diffusion models. In contrast with MUSE, it uses the smaller text encoder CLIP-L/14 instead of T5-XXL. Due to its small parameter count and few forward pass generation process, amused can generate many images quickly. This benefit is seen particularly at larger batch sizes.

Text-to-image generation

import torch
from diffusers import AmusedPipeline

pipe = AmusedPipeline.from_pretrained( "amused/amused-512", variant="fp16", torch_dtype=torch.float16 ) pipe.vqvae.to(torch.float32) # vqvae is producing nans in fp16 pipe = pipe.to("cuda")

prompt = "cowboy" image = pipe(prompt, generator=torch.manual_seed(8)).images[0] image.save("text2image_512.png")

Image-to-image generation

import torch
from diffusers import AmusedImg2ImgPipeline
from diffusers.utils import load_image

pipe = AmusedImg2ImgPipeline.from_pretrained( "amused/amused-512", variant="fp16", torch_dtype=torch.float16 ) pipe.vqvae.to(torch.float32) # vqvae is producing nans in fp16 pipe = pipe.to("cuda")

prompt = "apple watercolor" input_image = ( load_image( "https://raw.githubusercontent.com/huggingface/amused/main/assets/image2image_256_orig.png" ) .resize((512, 512)) .convert("RGB") )

image = pipe(prompt, input_image, strength=0.7, generator=torch.manual_seed(3)).images[0] image.save("image2image_512.png") </tr></table>

... (truncated)

Commits
  • 7f551e2 Release: v0.25.0
  • 645a62b Add PEFT to advanced training script (#6294)
  • 6414d4e Fix chunking in SVD (#6350)
  • 43672b4 Fix "push_to_hub only create repo in consistency model lora SDXL training scr...
  • 9df3d84 Fix LCM distillation bug when creating the guidance scale embeddings using mu...
  • c751449 fix: use retrieve_latents (#6337)
  • c1e8bdf Move ControlNetXS into Community Folder (#6316)
  • 78b87dc [LoRA] make LoRAs trained with peft loadable when peft isn't installed (#...
  • 0af12f1 amused update links to new repo (#6344)
  • 6e12368 Remove unused parameters and fixed FutureWarning (#6317)
  • Additional commits viewable in compare view


Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)