Tei update 1 4 0 - Githubissues

awslabs / llm-hosting-container

Large Language Model Hosting Container

Apache License 2.0

75 stars 32 forks source link

Closed philschmid closed 3 months ago

philschmid commented 3 months ago

Highlights:

New truncation direction parameter
Cuda support for JinaCode model architecture
Cuda support for Mistral model architecture
Cuda support for Alibaba GTE model architecture
New prompt name parameter: you can now add a prompt name to the body of your request to add a pre-prompt to your input, based on the Sentence Transformers configuration. You can also set a default prompt / prompt name to always add a pre-prompt to your requests.

rmarrugat commented 3 months ago

@haixiw Could you manually run the Action workflow manually in order to build and push the latest docker images?