hyperonym / basaran

Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.
MIT License
1.29k stars 81 forks source link

fix(server): significantly increase the default limits #159

Closed peakji closed 1 year ago

peakji commented 1 year ago

Workaround for https://github.com/hyperonym/basaran/issues/158

codecov-commenter commented 1 year ago

Codecov Report

Patch coverage: 100.00% and no project coverage change.

Comparison is base (562cb50) 94.54% compared to head (adf7027) 94.54%.

:mega: This organization is not using Codecov’s GitHub App Integration. We recommend you install it so Codecov can continue to function properly for your repositories. Learn more

Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #159 +/- ## ======================================= Coverage 94.54% 94.54% ======================================= Files 7 7 Lines 330 330 ======================================= Hits 312 312 Misses 18 18 ``` | [Impacted Files](https://codecov.io/gh/hyperonym/basaran/pull/159?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=hyperonym) | Coverage Δ | | |---|---|---| | [basaran/\_\_init\_\_.py](https://codecov.io/gh/hyperonym/basaran/pull/159?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=hyperonym#diff-YmFzYXJhbi9fX2luaXRfXy5weQ==) | `96.42% <100.00%> (ø)` | | Help us with your feedback. Take ten seconds to tell us [how you rate us](https://about.codecov.io/nps?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=hyperonym). Have a feature suggestion? [Share it here.](https://app.codecov.io/gh/feedback/?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=hyperonym)

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.