Open sidharthiimc opened 1 year ago
I tried MPT end to end in script form. Works like charm.
Can you provide a similar support to new Falcon model?
llm-rs-python is a wrapper around rustformers/llm. If the falcon support lands in rustformers/llm via https://github.com/rustformers/llm/issues/293 i'll include it in the wrapper.
llm-rs-python
I tried MPT end to end in script form. Works like charm.
Can you provide a similar support to new Falcon model?