Open ChorlingLau opened 1 year ago
Hi,
Thanks for the questions!
re 1: diffusion_steps is a parameter that I use to down-sample and run fewer diffusioin steps to speed up controllable generation. To debug, you could set this "diffusion_steps" to be 3k, but looking at the error message I dont think this is the source of the problem. I think the error message suggests something like you try to pass in a larger index than the dimension allows... Does this only happen for infill? what happens if you just decode unconditionally?
re 2: might be a type but '' --in_channel 64'' otherwise, yes. I think it's sufficient, just dont forget to pass in the updated --init_emb for run_clm.py
Hi,
Thanks for the questions!
re 1: diffusion_steps is a parameter that I use to down-sample and run fewer diffusioin steps to speed up controllable generation. To debug, you could set this "diffusion_steps" to be 3k, but looking at the error message I dont think this is the source of the problem. I think the error message suggests something like you try to pass in a larger index than the dimension allows... Does this only happen for infill? what happens if you just decode unconditionally?
re 2: might be a type but '' --in_channel 64'' otherwise, yes. I think it's sufficient, just dont forget to pass in the updated --init_emb for run_clm.py
Hi, does "diff_steps" have no effect on training a pure diffusion model without controllable generation?
Hi again! I would like to train a new diffusion model and a matched classifier with different diff_steps or embedding dimension, but I am confused about the parameters that need to be changed.
For different diff_steps, for example 3000, I change the parameters of
--diff_steps
to 3000 when runningimproved-diffusion/scripts/run_train.py
, some variables intransformers\examples\pytorch\language-modeling\run_clm.py
andimproved-diffusion/scripts/infill.py
which are nameddiffusion_steps
to 300. However, when runninginfill.py
, there are errors shown as follow:I failed to handle the error so can you show me a solution to change diff_steps?
For different embedding dimension, for example 32 (original 16), is it enough after the modification shown as follow? (omit other para) ①
run_train.py --inchannel 32
②run_clm.py --n_embd 32