Train DIT error: not support loading text feature directly

jy0205 / Pyramid-Flow

Code of Pyramidal Flow Matching for Efficient Video Generative Modeling

https://pyramid-flow.github.io/

MIT License

2.4k stars 233 forks source link

Train DIT error: not support loading text feature directly #181

Open LaLaLailalai opened 1 week ago

LaLaLailalai commented 1 week ago

Hi @jy0205, Thanks for the great work! I tried to run train_pyramid_flow_without_ar.sh, found OOM problem. So I try to remove the "load_text_encoder" and another error occurred, which is self.null_text_embeds wasn't defined, please check here. Do you know how to solve it?

jy0205 commented 6 days ago

Hi! You should pre-compute the null text embeds, (encode null str ""), you can refer to this issue https://github.com/jy0205/Pyramid-Flow/issues/160

LaLaLailalai commented 1 day ago

Hi! You should pre-compute the null text embeds, (encode null str ""), you can refer to this issue #160

Thanks! Fixed it!