search

hyperonym / basaran

Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.
MIT License
1.29k stars 81 forks source link

Runpod Serverless #288

Open stonejohnson opened 6 months ago

stonejohnson commented 6 months ago

Is there a plan or an implementation of basaran for the runpod serverless environment?

peakji commented 6 months ago

Possibly duplicated: https://github.com/hyperonym/basaran/issues/58