search

GuernikaCore / GuernikaKit

MIT License
39 stars 10 forks source link

Unable to run StableDiffusionXLPipeline #5

Open zephyrzhu1998 opened 8 months ago

zephyrzhu1998 commented 8 months ago

Hi, I have been trying to run StableDiffusionXLPipeline on my ipad. However, it seems that there are some issues in TextEncoder.

I found that StableDiffusionXLPipeline TextEncoder1, StableDiffusionXLPipeline TextEncoder2 and StableDiffusionMainPipeline use the same TextEncoder. Does it also support SDXL?

        // Stable Diffusion 2.X TextEncoder
        self.hiddenSize = 1024
    } else {
        self.hiddenSize = 768
    }

I remembered the hiddenSize of TextEncoders in SDXL, one is 768 and one is 1280.

Please advise. Thanks!

Dalchrome commented 8 months ago

Make sure you are using files converted by Guernika model converter. If you take a look at Mochi Diffusion pull requests, there is a fork implementing Guernika, the Mochi licence means the code can not be used in closed source apps, but it's a really good code base to learn from. (this fork https://github.com/czkoko/MochiDiffusion) there is also a lot of discussion about Guernika kit on the Mochi discord, a few people there also work on our own apps