marella / ctransformers

Python bindings for the Transformer models implemented in C/C++ using GGML library.
MIT License
1.8k stars 137 forks source link

Support for vision-language model #122

Open dnth opened 1 year ago

dnth commented 1 year ago

Does ctransformers currently support running vision-language model?

I'd like to run BLIP2 model from Salesforce hosted on Hugging Face - https://huggingface.co/Salesforce/blip2-opt-2.7b