h-zhao1997 / cobra

Cobra: Extending Mamba to Multi-modal Large Language Model for Efficient Inference
MIT License
249 stars 8 forks source link

About the evaluation code #3

Closed Lauch1ng closed 4 months ago

Lauch1ng commented 6 months ago

Hi! Will you release the evaluation code for Cobra? (e.g., evaluation on benchmarks like text-vqa, pope, etc.) Thanks a lot.

h-zhao1997 commented 6 months ago

I'm sorry, but we currently have no plans to release the evaluation code. However, it should be relatively straightforward to replicate the evaluation for Cobra based on open-source codes, such as the codebase of LLaVA.