louaaron / Score-Entropy-Discrete-Diffusion

[ICML 2024 Best Paper] Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution (https://arxiv.org/abs/2310.16834)
https://aaronlou.com/blog/2024/discrete-diffusion/
MIT License
352 stars 33 forks source link

Suffix, prefix, and ? #1

Closed LoganALJones closed 6 months ago

LoganALJones commented 6 months ago

Can we run with prompt tokens in the middle (besides just running it twice)

louaaron commented 6 months ago

Yeah, but this must be done manually by replacing the lines: https://github.com/louaaron/Score-Entropy-Discrete-Diffusion/blob/main/run_sample_cond.py#L27-L28