search

xiaoachen98 / Open-LLaVA-NeXT

An open-source implementation for training LLaVA-NeXT.
398 stars 20 forks source link

Is the LLM of OpenLLaVA-NeXT-LLaMA-3 base or instruct version? #20

Closed RiverGao closed 2 months ago

RiverGao commented 2 months ago

Hi, thank you very much for your effort on OpenLLaVA! I want to know whether the LLM of the LLaMA-3 based model is the base version or the instruct version, because in the original LLaVA-NeXT work they use the instruct version, but here in the form it is said to be "LLaMA-3-8B".

Thank you!

RiverGao commented 2 months ago

Also, could you please share the hyper-parameters for pretraining and finetuning the LLaMA-3 based model? Thank you very much!

xiaoachen98 commented 2 months ago

Hi, thank you very much for your effort on OpenLLaVA! I want to know whether the LLM of the LLaMA-3 based model is the base version or the instruct version, because in the original LLaVA-NeXT work they use the instruct version, but here in the form it is said to be "LLaMA-3-8B".

Thank you!

I utilize the instruct version. Hoping this will help you.