Soulter / hugging-chat-api

HuggingChat Python API🤗
GNU Affero General Public License v3.0
836 stars 121 forks source link

Support for Mixtral 8x7B #146

Closed tomjuggler closed 10 months ago

tomjuggler commented 10 months ago

Not sure how easy it is to add models, but this one is proving the best so far, and is available on Hugging Chat.

Model: mistralai/Mixtral-8x7B-Instruct-v0.1

Soulter commented 10 months ago

Hi, this codes may meet your demand.

# Get the available models (not hardcore)
models: list = chatbot.get_available_llm_models()

# Switch model to the given index
chatbot.switch_llm(0) # Switch to the first model
chatbot.switch_llm(1) # Switch to the second model
tomjuggler commented 10 months ago

['meta-llama/Llama-2-70b-chat-hf', 'OpenAssistant/oasst-sft-6-llama-30b-xor', 'codellama/CodeLlama-34b-Instruct-hf', 'tiiuae/falcon-180B-chat']

Those are the only ones available from chatbot.get_available_llm_models(), is there a way to have Mixtral 8x7B show up here?

Soulter commented 10 months ago

What version of hugchat are you using?

pip3 show hugchat
tomjuggler commented 10 months ago

So sorry I just updated and it's option 5 on the list.