p0p4k / pflowtts_pytorch

Unofficial implementation of NVIDIA P-Flow TTS paper
https://neurips.cc/virtual/2023/poster/69899
MIT License
198 stars 28 forks source link

2nd-order Heun's method for ODE sampling #36

Closed kunibald413 closed 2 weeks ago

kunibald413 commented 4 months ago

as mentioned here https://openreview.net/forum?id=zNA7u7wtIN&noteId=aiIagkNqgq

https://openreview.net/attachment?id=Ymg8GZvGds&name=pdf

you have a take on this and would it be easy to implement and try?

p0p4k commented 4 months ago

Will try it, if you have any resources for it lmk.

kunibald413 commented 4 months ago

I have to say that i have close to no experience with this kind of math.

maybe this has some inspiration (searched heun's method on github)

https://github.com/matplotlib/matplotlib/blob/9618fc6322745834dd098cadecf8e05a0917d498/lib/matplotlib/streamplot.py#L514C17-L514C19

https://github.com/openai/shap-e/blob/50131012ee11c9d2617f3886c10f000d3c7a3b43/shap_e/diffusion/k_diffusion.py#L273