search

RUCAIBox / LLMBox

A comprehensive library for implementing LLMs, including a unified training pipeline and comprehensive model evaluation.
MIT License
578 stars 74 forks source link

Fix bugs in openai.py, AGIEval. Add AGIEval_single_choice dataset #198

Closed CoderBak closed 5 months ago

CoderBak commented 5 months ago

I added AGIEval_single_choice dataset, which inherits the Multiple_Choice_dataset

CoderBak commented 5 months ago 
python inference.py -m /home/tangtianyi/Llama-2-7b-hf --model_type instruction --num_shots 5 --vllm True --flash_attention True --max_tokens 4096 --max_example_tokens 3072 -d agieval_single_choice:sat-math