The-FinAI / PIXIU

This repository introduces PIXIU, an open-source resource featuring the first financial large language models (LLMs), instruction tuning data, and evaluation benchmarks to holistically assess financial LLMs. Our goal is to continually push forward the open-source development of financial artificial intelligence (AI).
MIT License
523 stars 62 forks source link

KeyError hf-causal-llama #33

Closed nyBball closed 12 months ago

nyBball commented 12 months ago

Hello, from lm_eval: https://github.com/EleutherAI/lm-evaluation-harness/blob/master/lm_eval/models/__init__.py, there is no key named 'hf-causal-llama', can you give the corresponding code of hf-causal-llama?

Thanks

tothemoon96 commented 12 months ago

we modify lm-evaluation-harness and you must git clone --recursive

nyBball commented 12 months ago

Thanks