convert_xtuner_weights_to_llava.py and convert_xtuner_weights_to_hf.py can support llava-next model?

[awzhgw]

i has use https://github.com/hhaAndroid/xtuner/tree/refactor_llava train llava_1.6_phi3_8B model .

but ,it cannot convert to office llava model use convert_xtuner_weights_to_llava.py

can you help me ?

641

@LZHgrla @hhaAndroid

help me ? thanks

[awzhgw]

@hhaAndroid @LZHgrla i use config file is :https://github.com/hhaAndroid/xtuner/blob/refactor_llava/xtuner/configs/llava/phi3_mini_chat/llava_phi3_mini_4k_instruct_full_clip_vit_large_lora_p14_336_anyres_e1_gpu8_internvl_finetune.py

i has train model ..but cannot convert to office llava format model ,can you help me ?

the convert_xtuner_weights_to_llava.py and convert_xtuner_weights_to_hf.py can support llava-next model ?

[pppppM]

The script convert_xtuner_weights_to_llava.py is only compatible with the main branch. The refactor_llava branch is still under development, and frequent changes may occur.