Question on the Role of Text Encoder in Bunny MLLM Architecture

[codefanw]

Thanks for your impressive work! The idea of integrating a text encoder before the large language model caught my attention. Could you share the specific benefits this approach provides? Also, were any ablation studies performed to quantify the impact of this component on overall performance?

[Isaachhh]

The text encoder in our architecture figure represents for the tokenizer of LLM.

[codefanw]

Alright, thank you for your answer!