Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.
MIT License
1.29k
stars
81
forks
source link
Replace EventSource with POST requests in playground #145
Encoding
prompt
as query parameters can lead to414 URI Too Long
for long user inputs. We should replaceEventSource
with native POST requests.