search

TensorStack-AI / OnnxStack

C# Stable Diffusion using ONNX Runtime
Apache License 2.0
221 stars 33 forks source link

StableCascade Pipeline #134

Closed saddam213 closed 6 months ago

saddam213 commented 7 months ago

Pipeline for StableCascade diffusion process

Tasks

AshD commented 7 months ago

I added a request on Feb 16 to convert this model in onnx format. https://huggingface.co/stabilityai/stable-cascade/discussions/16

Will try to see if I can do it next week.

saddam213 commented 7 months ago

Success!!!!

Well sort of, Pipeline now runs end to end without errors, all models seem to be accepting the inputs and outputting data

Flow: Tokenizer -> TextEncoder -> PriorUnet -> DecoderUnet -> VQGAN

Output is garbage but that was expected as we need a new Scheduler DDPMWuerstchenScheduler https://github.com/huggingface/diffusers/blob/main/src/diffusers/schedulers/scheduling_ddpm_wuerstchen.py

Its possible my model conversion is not correct, but we will see once I have the new scheduler implemented

saddam213 commented 7 months ago

output3

Its working, woot!!

saddam213 commented 6 months ago

Image quality from the new DDPMWuerstchen Scheduler is much better"

an image of a shiba inu, donning a spacesuit and helmet output1

photo of a cat output2