Fix evaluation script - Githubissues

Nota-NetsPresso / shortened-llm

Compressed LLMs for Efficient Text Generation [ICLR'24 Workshop]

63 stars 8 forks source link

Fix evaluation script #2

Closed bokyeong1015 closed 6 months ago

bokyeong1015 commented 6 months ago

Description

Minor fix for the evaluation script
Addition of the results folder

Change(s)

Added --fix_decapoda_config option to llama-1-based models in script/evaluate.sh
- This does not affect PPL values, while displaying \ as the BOS token (instead of \<??>) in gen_text.txt
Added the results folder to quickly check PPL, generated text, and accuracy values.