llm-jp / scripts

Apache License 2.0
1 stars 1 forks source link

Add evaluation scripts (llm-jp-eval v1.4.1 with vllm) #34

Closed YumaTsuta closed 1 week ago

YumaTsuta commented 1 week ago

This PR adds scripts for model evaluation using llm-jp-eval (v1.4.1). It includes a setup script for creating the environment to run the evaluation script, as well as a script for running the offline evaluation using vLLM.