Implement repetition penalty when generating with autoregressive models.
The original method is described in CTRL paper
Added the ability to provide the size of the context window (instead of the whole generated sequence) to allow repetition after a few words (normal for long texts)
Implement repetition penalty when generating with autoregressive models.
The original method is described in CTRL paper Added the ability to provide the size of the context window (instead of the whole generated sequence) to allow repetition after a few words (normal for long texts)