search

hyperonym / basaran

Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.
MIT License
1.29k stars 80 forks source link

Support ARM Docker images #110

Closed WillBeebe closed 1 year ago

WillBeebe commented 1 year ago

As a local workaround, add the --platform tag.

docker run -p 80:80 -e MODEL=user/repo --platform=linux/amd64 hyperonym/basaran:0.13.5

peakji commented 1 year ago

Fixed in https://github.com/hyperonym/basaran/pull/111 thanks to @WillBeebe. The next release will include image for linux/arm64.