search

LLaVA-VL / LLaVA-NeXT

Apache License 2.0
2.4k stars 167 forks source link

performance problem of llava-next-video-34b DPO model #202

Open YoungjaeDev opened 1 week ago

YoungjaeDev commented 1 week ago

The llava-next-video-34b DPO model is not performing well, whereas the 7B-dpo model works fine.

I've reviewed related issues and tried _changing the conv mode to mistraldirect, but the responses still seem off. I also updated IMAGE_TOKEN_INDEX to 64002, but the performance issues persist.

Could you advise on how to resolve this?

ZhangYuanhan-AI commented 1 week ago

Hi, could you please show me the logging?

YoungjaeDev commented 1 week ago

Anyone else relate to this?