search

dottxt-ai / outlines

Structured Text Generation
https://dottxt-ai.github.io/outlines/
Apache License 2.0
8.82k stars 441 forks source link

MiniCPM V2.6 Support #1208

Open diptanu opened 6 days ago

diptanu commented 6 days ago

Hey guys, I am trying to use MiniCPMV6 with Outlines using https://huggingface.co/openbmb/MiniCPM-V-2_6

I am using the outlines.models.transformers_vision api to load the model, but I can't find the ModelClass defined anywhere in the transformers codebase. Any idea on what I should use for the model_class arg?

lapp0 commented 6 days ago

Does AutoModelForCausalLM work? https://huggingface.co/openbmb/MiniCPM-V-2_6/blob/main/config.json#L10