Feature Request: Falcon 7B support

LLukas22 / llm-rs-python

Unofficial python bindings for the rust llm library. 🐍❤️🦀

MIT License

71 stars 4 forks source link

Open sidharthiimc opened 1 year ago

sidharthiimc commented 1 year ago

I tried MPT end to end in script form. Works like charm.

Can you provide a similar support to new Falcon model?

LLukas22 commented 1 year ago

llm-rs-python is a wrapper around rustformers/llm. If the falcon support lands in rustformers/llm via https://github.com/rustformers/llm/issues/293 i'll include it in the wrapper.