v0.2.0 - Githubissues

pfnet-research / japanese-lm-fin-harness

Japanese Language Model Financial Evaluation Harness

MIT License

65 stars 5 forks source link

v0.2.0 #6

Closed masanorihirano closed 5 months ago

masanorihirano commented 6 months ago

feat:

cpa_audit data is directly imported into this repository
lm_eval updated
mode results update
length normed results are supported
anthropic and vertexai supports

bugfix:

chabsa-1.0-0.5 prompts