search

mlc-ai / llm-perf-bench

Apache License 2.0
109 stars 12 forks source link

which repo to download from hugging face for 7b / 13b to try out? #12

Closed hiqsociety closed 11 months ago

hiqsociety commented 11 months ago

which repo to download from hugging face for 7b / 13b to try out? i did git clone https://huggingface.co/mlc-ai/mlc-chat-Llama-2-13b-chat-hf-q4f16_1

but it generated a 3.3mb directory. any help on this?

junrushao commented 11 months ago

3.3M doesn't look right. Could you double check if you are using "git LFS" already? Run the following command:

git lfs install

and then clone again