issues
search
Nota-NetsPresso
/
shortened-llm
Compressed LLMs for Efficient Text Generation [ICLR'24 Workshop]
63
stars
8
forks
source link
Fix evaluation script
#2
Closed
bokyeong1015
closed
6 months ago
bokyeong1015
commented
6 months ago
Description
Minor fix for the evaluation script
Addition of the results folder
Change(s)
Added
--fix_decapoda_config
option to llama-1-based models in
script/evaluate.sh
This does not affect PPL values, while displaying \
as the BOS token (instead of \<??>) in
gen_text.txt
Added the results folder to quickly check PPL, generated text, and accuracy values.
Description
Change(s)
--fix_decapoda_config
option to llama-1-based models inscript/evaluate.sh
gen_text.txt