search

simonw / llm-mistral

LLM plugin providing access to Mistral models using the Mistral API
Apache License 2.0
144 stars 14 forks source link

Add Codestral and Codestral Mamba (not yet MathΣtral as it is not in the API) #8

Closed mcotdev closed 2 months ago

mcotdev commented 3 months ago

Any chance of adding Codestral?

simonw commented 2 months ago

And the two new models too!

simonw commented 2 months ago

This doesn't actually need a new release of the plugin. You can run the llm mistral refresh command instead.

Before:

$ llm models
OpenAI Chat: gpt-3.5-turbo (aliases: 3.5, chatgpt)
OpenAI Chat: gpt-3.5-turbo-16k (aliases: chatgpt-16k, 3.5-16k, turbo)
OpenAI Chat: gpt-4 (aliases: 4, gpt4)
OpenAI Chat: gpt-4-32k (aliases: 4-32k)
OpenAI Completion: gpt-3.5-turbo-instruct (aliases: 3.5-instruct, chatgpt-instruct, instruct)
Mistral: mistral/open-mistral-7b
Mistral: mistral/mistral-tiny-2312
Mistral: mistral/mistral-tiny (aliases: mistral-tiny)
Mistral: mistral/open-mixtral-8x7b
Mistral: mistral/open-mixtral-8x22b
Mistral: mistral/open-mixtral-8x22b-2404
Mistral: mistral/mistral-small-2312
Mistral: mistral/mistral-small (aliases: mistral-small)
Mistral: mistral/mistral-small-2402
Mistral: mistral/mistral-small-latest
Mistral: mistral/mistral-medium-latest
Mistral: mistral/mistral-medium-2312
Mistral: mistral/mistral-medium (aliases: mistral-medium)
Mistral: mistral/mistral-large-latest (aliases: mistral-large)
Mistral: mistral/mistral-large-2402

Running llm mistral refresh:

$ llm mistral refresh
Added models: codestral-mamba-latest, codestral-2405, codestral-latest, codestral-mamba-2407
New list of models:
open-mistral-7b
mistral-tiny-2312
mistral-tiny
open-mixtral-8x7b
open-mixtral-8x22b
open-mixtral-8x22b-2404
mistral-small-2312
mistral-small
mistral-small-2402
mistral-small-latest
mistral-medium-latest
mistral-medium-2312
mistral-medium
mistral-large-latest
mistral-large-2402
codestral-2405
codestral-latest
codestral-mamba-2407
codestral-mamba-latest

After:

$ llm models
OpenAI Chat: gpt-3.5-turbo (aliases: 3.5, chatgpt)
OpenAI Chat: gpt-3.5-turbo-16k (aliases: chatgpt-16k, 3.5-16k, turbo)
OpenAI Chat: gpt-4 (aliases: 4, gpt4)
OpenAI Chat: gpt-4-32k (aliases: 4-32k)
OpenAI Completion: gpt-3.5-turbo-instruct (aliases: 3.5-instruct, chatgpt-instruct, instruct)
Mistral: mistral/open-mistral-7b
Mistral: mistral/mistral-tiny-2312
Mistral: mistral/mistral-tiny (aliases: mistral-tiny)
Mistral: mistral/open-mixtral-8x7b
Mistral: mistral/open-mixtral-8x22b
Mistral: mistral/open-mixtral-8x22b-2404
Mistral: mistral/mistral-small-2312
Mistral: mistral/mistral-small (aliases: mistral-small)
Mistral: mistral/mistral-small-2402
Mistral: mistral/mistral-small-latest
Mistral: mistral/mistral-medium-latest
Mistral: mistral/mistral-medium-2312
Mistral: mistral/mistral-medium (aliases: mistral-medium)
Mistral: mistral/mistral-large-latest (aliases: mistral-large)
Mistral: mistral/mistral-large-2402
Mistral: mistral/codestral-2405
Mistral: mistral/codestral-latest
Mistral: mistral/codestral-mamba-2407
Mistral: mistral/codestral-mamba-latest

I'll still push a new release though to add nicer aliases for those new models.

simonw commented 2 months ago

Looks like Mathstral isn't in the API yet.