hyperonym / basaran

Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.
MIT License
1.29k stars 81 forks source link

Suggestion: Passthrough to OpenAI GPT3.5 for testing #273

Open FetchFast opened 8 months ago

FetchFast commented 8 months ago

If you could just pass on requests to OpenAI, you'd have a quicker way to test connecting apps.