[Numpy] Generation script improvement

dmlc / gluon-nlp

NLP made easy

https://nlp.gluon.ai/

Apache License 2.0

2.56k stars 538 forks source link

Closed sxjscience closed 3 years ago

sxjscience commented 3 years ago

The GPT-2 generation example https://github.com/dmlc/gluon-nlp/pull/1354 has been merged but there are further improvements that we can do:

[x] Rename 'generate' (https://github.com/dmlc/gluon-nlp/tree/master/scripts/generate) --> 'generation'
[x] Support sampling from the TN layout, which will be faster for sequence sampling.

@hymzoque