llava-phi3-mini conversion to gguf format

InternLM / xtuner

An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)

https://xtuner.readthedocs.io/zh-cn/latest/

Apache License 2.0

3.72k stars 302 forks source link

Open nakoeni opened 3 months ago

nakoeni commented 3 months ago

How can I convert from Llama LLM or official LLaVA format or HuggingFace LLaVA format to gguf format?

hhaAndroid commented 2 months ago

@nakoeni I'm sorry, the conversion process is rather cumbersome, so we haven't provided that for now.