search

jy0205 / Pyramid-Flow

Code of Pyramidal Flow Matching for Efficient Video Generative Modeling
https://pyramid-flow.github.io/
MIT License
2.4k stars 233 forks source link

DiT Finetuning #166

Open zjq-Jackson opened 2 weeks ago

zjq-Jackson commented 2 weeks ago

"I only have one A800 80G; can I fine-tune the DiT model with it?"

feifeiobama commented 2 weeks ago

Sorry, you cannot do this with our current implementation. Even if it were possible, it would require a lot of code changes, e.g. accumulating the gradient for all sequence lengths in a video clip.

zjq-Jackson commented 2 weeks ago

Alright, thank you very much!