search

jjihwan / FIFO-Diffusion_public

Official implementation of FIFO-Diffusion
https://jjihwan.github.io
277 stars 17 forks source link

where is the open-sora-plan code? #11

Closed Edwardmark closed 3 weeks ago

Edwardmark commented 1 month ago

Thanks for your open-sourcing the code, but where is the open-sora-plan code?

jjihwan commented 1 month ago

For Open-Sora Plan, we are implementing parallel inference and other schedulers (e.g., PNDM scheduler). However, since I don't have much time to maintain this repository, it will take some time 🥲.

pokameng commented 4 weeks ago

@jjihwan hello， I am integrating FIFO in Sora, can you provide some guidance? THX！！！

jjihwan commented 4 weeks ago

@pokameng Hi, thank you for the waiting. I'm trying to release the source code for open sora plan within 3~5 days. If you want to implement yourself, please refer to VideoCrafter's code.

pokameng commented 4 weeks ago

@jjihwan hello ，I am integrating FIFO in Sora rather than open-sora-plan

jjihwan commented 4 weeks ago

Oh, I see. Since Open-Sora is also a DiT-based model like the Open-Sora Plan, I think you can refer to the code for the Open-Sora Plan once it is released.

You might need to re-implement:

  1. timestep injection (different for each frame)
  2. first-in, first-out queue for diagonal denoising in the main pipeline
  3. latent partitioning and lookahead denoising
pokameng commented 4 weeks ago

Oh, I see. Since Open-Sora is also a DiT-based model like the Open-Sora Plan, I think you can refer to the code for the Open-Sora Plan once it is released.

You might need to re-implement:

  1. timestep injection (different for each frame)
  2. first-in, first-out queue for diagonal denoising in the main pipeline
  3. latent partitioning and lookahead denoising

OKOK, look forward your codes releasing!!