search

OpenPPL / ppl.llm.serving

Apache License 2.0
123 stars 13 forks source link

support for huggingface llama? #16

Closed sleepwalker2017 closed 1 year ago

sleepwalker2017 commented 1 year ago

We use vicuna in huggingface format. I notice only meta format is supported ? Is that true?

Alcanderian commented 1 year ago

The script for converting huggingface format to meta format will be released ASAP in https://github.com/openppl-public/ppl.pmx

sleepwalker2017 commented 1 year ago

The script for converting huggingface format to meta format will be released ASAP in https://github.com/openppl-public/ppl.pmx

thank you, got it.

Vincent-syr commented 1 year ago

Here is the exporting script for llama hugging face https://github.com/openppl-public/ppl.pmx/tree/master/model_zoo/llama/huggingface