search

bentoml / OpenLLM

Run any open-source LLMs, such as Llama, Mistral, as OpenAI compatible API endpoint in the cloud.
https://bentoml.com
Apache License 2.0
10.11k stars 640 forks source link

Documentation #1037

Closed mikolajpabiszczak closed 4 months ago

mikolajpabiszczak commented 4 months ago

Is there any updated documentation/howto use OpenLLM? What is in README is outdated; pip package version is different from the last release in this repo.

If you are not going to update Readme extensively, can you at least please mention which is the last version it is applicable to?

bojiang commented 4 months ago

Updated. Thanks. It was an intermediate stage. OpenLLM is working on a big iteration for easy of use.