search

InternLM / xtuner

An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)
https://xtuner.readthedocs.io/zh-cn/latest/
Apache License 2.0
3.73k stars 302 forks source link

feature request: phi 3 in llava #613

Closed Jayantverma2 closed 4 months ago

Jayantverma2 commented 4 months ago

Please integrate phi 3 with llava as it is equivalent to llama 3 on benchmarks

LZHgrla commented 4 months ago

Hi @Jayantverma2 We are working on it, and the first version of this model will be released tomorrow.

LZHgrla commented 4 months ago

@Jayantverma2

Here! https://github.com/InternLM/xtuner/tree/main/xtuner/configs/llava/phi3_mini_4k_instruct_clip_vit_large_p14_336