Train with mpt 8k - Githubissues

gorilla-llm / gorilla-cli

LLMs for your CLI

https://gorilla.cs.berkeley.edu/

Apache License 2.0

1.28k stars 75 forks source link

Train with mpt 8k #23

Closed fire closed 1 year ago

fire commented 1 year ago

Would it be expensive to train with mpt 8k? Can you provide an mpt 8k model?

https://huggingface.co/mosaicml/mpt-7b-8k

ShishirPatil commented 1 year ago

Good question @fire ! MPT-7B-8k is not Apache 2.0 licensed. So, if users want to use gorilla-cli on their corporate laptops, or even build on top of Gorilla, the licensing might become tricky. We are trying to build gorilla to be 100% open sourced, that others can use freely on build on-top-of. So, no - it won't be expensive, but not clear we should do it. What do you think? 👀

fire commented 1 year ago

As far as I know it is apache-2 licensed. Can you check again?

Appache 2.0 licensed models with 8k context are rare.

fire commented 1 year ago

I'll close the issue since there was no reply.