search

hyperonym / basaran

Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.
MIT License
1.29k stars 79 forks source link

Runpod Serverless #288

Open stonejohnson opened 11 months ago

stonejohnson commented 11 months ago

Is there a plan or an implementation of basaran for the runpod serverless environment?

peakji commented 11 months ago

Possibly duplicated: https://github.com/hyperonym/basaran/issues/58