search

hyperonym / basaran

Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.
MIT License
1.29k stars 80 forks source link

:latest version tag #138

Open mariushosting opened 1 year ago

mariushosting commented 1 year ago

Can you please add the :latest tag version to the newest Docker image instead of :0.15.2, :0.15.3 etc? So people will stop to manually change the version everytime when new Docker version is out.

peakji commented 1 year ago

Hi @mariushosting!

In fact, we've been intentionally avoid using the latest tag. Apart from some common controversies, the main reason is that Basaran needs to ensure that the CUDA version inside the container is compatible with the Nvidia software environment on the host machine, which is quite different from standard containerized applications. Therefore, to prevent surprising existing users, we only use explicit versions to tag the images.

Of course, we don't want to be too dogmatic, so we would like to take this opportunity to hear everyone's suggestions!

Abdiesel23 commented 12 months ago

ya but the quick start guide just says to use the latest version anyway