search

mhh0318 / OneMoreStep

19 stars 1 forks source link

How can I use it to custom SD model, like AnimateAnyone, AnimateDiff? #1

Open VisionU opened 8 months ago

VisionU commented 8 months ago

Very nice job! If I use it to custom SD model, did I train it use LAION 2B dataset said in your paper?

mhh0318 commented 8 months ago

Hi, we have released the pretrained model. There's no additional training requirement for it only if your custom SD model is using the same latent space (in another word the same VAE). You can download the pretrained OMS and it's corresponding inference pipeline here: https://huggingface.co/h1t/oms_b_openclip_xl/tree/main and https://huggingface.co/spaces/h1t/oms_sdxl_lcm/tree/main