TRI-ML / prismatic-vlms

A flexible and efficient codebase for training visually-conditioned language models (VLMs)
MIT License
425 stars 194 forks source link

Does this software support CogVLM? #13

Closed PhilipAmadasun closed 5 months ago

PhilipAmadasun commented 5 months ago

Does this software support CogVLM?

ashwin-balakrishna96 commented 5 months ago

We don't currently support CogVLM as this came out on arXiv after we finished finalizing our experiments. However, CogVLM would be great to support and we will definitely consider it when adding new architectures in the near future. In the meantime, if you have any other VLMs you'd like prismatic to support and can open up a PR implementing this support, we would be happy to review and include it.