stikkireddy / mlflow-extensions

Deploy models quickly to databricks via mlflow based serving infra.
https://stikkireddy.github.io/mlflow-extensions/
Apache License 2.0
15 stars 9 forks source link

[MODEL] Support CohereForAI/aya-23-35B #36

Closed stikkireddy closed 1 month ago

stikkireddy commented 1 month ago

Support CohereForAI/aya-23-35B for vllm which supports CohereForCausalLM architecture https://huggingface.co/CohereForAI/aya-23-35B/blob/main/config.json

stikkireddy commented 1 month ago

released in https://github.com/stikkireddy/mlflow-extensions/releases/tag/v0.11.0