marella / ctransformers

Python bindings for the Transformer models implemented in C/C++ using GGML library.
MIT License
1.76k stars 137 forks source link

Adding additional models #161

Open harryjulian opened 8 months ago

harryjulian commented 8 months ago

Hi there,

What's the process for adding new models? I'd theoretically like to quantize and run a version of Meta's Nougat model in CTransformers at some point. I'd be happy to have a go at creating an implementation, just wondering if this would be of interest or if it's out of scope for the library.