mini-sora / minisora

MiniSora: A community aims to explore the implementation path and future development direction of Sora.
https://github.com/mini-sora/minisora
Apache License 2.0
1.21k stars 151 forks source link

Copy ELLA paper to `Diffusion UNet` and `training efficiency` #346

Closed chg0901 closed 7 months ago

chg0901 commented 7 months ago

image

ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignment

Efficient Large Language Model Adapter, termed ELLA,

不使用transforer的diffusion结构

training efficiency、 Comprehending Dense Prompts、 Multi-modal Language Model (MLLM)、Dense Prompt Graph Benchmark (DPGBench): A new benchmark 、 Timestep-Aware Semantic Connector (TSC)

This issue is related to

@BestAnHongjun

chg0901 commented 7 months ago

This issue is solved by issue