search

comfyanonymous / ComfyUI

The most powerful and modular stable diffusion GUI, api and backend with a graph/nodes interface.
https://www.comfy.org/
GNU General Public License v3.0
43.45k stars 4.6k forks source link

Implement Efficient Large Language Model Adapters (ELLA) #3018

Open InCrIpTiOn opened 4 months ago

InCrIpTiOn commented 4 months ago

Paper: https://arxiv.org/pdf/2403.05135.pdf Motivation: Massively betters prompt understanding, is an adaptation to unet so can be applied to previous models (trained with 1.5 and SDXL) Weights will be available next week (https://github.com/ELLA-Diffusion/ELLA/issues/3)

TheHmmka commented 4 months ago

Waiting!

whitepapercg commented 3 months ago

1.5 is ready QQGYLab/ELLA

codeinvain commented 3 months ago

if it helps there are two comfy extensions that implemented it https://github.com/kijai/ComfyUI-ELLA-wrapper https://github.com/ExponentialML/ComfyUI_ELLA

MythicalChu commented 3 months ago

The official one is out: https://github.com/TencentQQGYLab/ComfyUI-ELLA