search

yuanzhi-zhu / prolific_dreamer2d

Unofficial implementation of 2D ProlificDreamer
137 stars 6 forks source link

Why use DDIM scheduler? #5

Closed jhq1234 closed 1 year ago

jhq1234 commented 1 year ago

Hi, Thanks for uploading your work. I really enjoy this!

I have a question about your code. In prolific_dreamer2d.py(https://github.com/yuanzhi-zhu/prolific_dreamer2d/blob/main/prolific_dreamer2d.py#L163), you use DDIM scheduler for scheduling. Can I ask why you use DDIM scheduler, not DDPM or others? Thanks!

yuanzhi-zhu commented 1 year ago

This is rather a handwavy choice, you can also try the other schedulers. As long as we can get the correct precious state $x_{t-1}$ and predicted $x_0$, the specific scheduler used should not significantly impact the results.

jhq1234 commented 1 year ago

@yuanzhi-zhu Thank you for your quick response! I didn't know you'd answer quickly like this, I understand that scheduler choice part! Thanks!

Have you conducted an experiment on a single particle (One single image)?

yuanzhi-zhu commented 1 year ago

By default, we are using a single particle (see the figure in readme).