search

city96 / ComfyUI_ExtraModels

Support for miscellaneous image models. Currently supports: DiT, PixArt, HunYuanDiT, MiaoBi, and a few VAEs.
Apache License 2.0
394 stars 35 forks source link

Any possibility to support 900M param Pixart Sigma models? #68

Open jwooldridge234 opened 5 months ago

jwooldridge234 commented 5 months ago

PsuedoTerminal is doing some really interesting work with expanding the model depth from 28 -> 42 and finetuning on new data, for example: https://huggingface.co/ptx0/pixart-900m-1024-ft

I tried hacking the code to increase the depth, but while I could get it loading and eliminated the missing/dropped keys error (by modifying the depth values across all the files), there was clearly a render error- sort of recognizable shapes with a lot of noise and distortion. Maybe someone smarter than me can take a crack at this?

GavChap commented 5 months ago

https://github.com/city96/ComfyUI_ExtraModels/pull/65 this is being worked on right now.

GavChap commented 5 months ago

This is now merged, so you can now use 900M and 600M sigma models in ComfyUI_ExtraModels