There is tremendous confusion about which chat templates to use with which models

LLaVA-VL / LLaVA-NeXT

1.01k stars 55 forks source link

There is tremendous confusion about which chat templates to use with which models #55

Open doctorpangloss opened 3 weeks ago

doctorpangloss commented 3 weeks ago

The best thing to do would be to author correct chat templates in both your repository's huggingface models and the official huggingface ones. It should also interact with the AutoProcessor loaded LlavaProcessor correctly.