search

huggingface / nanotron

Minimalistic large language model 3D-parallelism training
Apache License 2.0
1.14k stars 107 forks source link

Haojun/inference #142

Open zzhhjjj opened 5 months ago

zzhhjjj commented 5 months ago

use the config in the run_generation.py script as we did in other scripts. Add a for_inference argument to support fixed outcome inference