Support generation tasks for eval.py

pytorch-labs / gpt-fast

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

BSD 3-Clause "New" or "Revised" License

5.67k stars 513 forks source link

Open mostafaelhoushi opened 1 month ago

mostafaelhoushi commented 1 month ago

I have created this PR to enable generation tasks.

To test:

python eval.py --checkpoint_path checkpoints/$MODEL_REPO/model.pth --tasks nq_open