issues
search
hyperonym
/
basaran
Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.
MIT License
1.29k
stars
81
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
build(deps): update transformers[sentencepiece] requirement from ~=4.29.1 to ~=4.29.2
#194
dependabot[bot]
closed
1 year ago
1
How to set my own parameters in model.generate() in basaran?
#193
zoubaihan
opened
1 year ago
2
Inference should stop if connection is aborted/closed
#192
josephrocca
closed
1 year ago
2
build(deps): update transformers[sentencepiece] requirement from ~=4.29.0 to ~=4.29.1
#191
dependabot[bot]
closed
1 year ago
0
build(deps): update transformers[sentencepiece] requirement from ~=4.28.1 to ~=4.29.0
#190
dependabot[bot]
closed
1 year ago
1
build(deps): update accelerate requirement from ~=0.18.0 to ~=0.19.0
#189
dependabot[bot]
closed
1 year ago
0
build(deps): update huggingface-hub requirement from ~=0.14.0 to ~=0.14.1
#188
dependabot[bot]
closed
1 year ago
1
build(*): bump version to 0.17.2
#187
peakji
closed
1 year ago
0
build(docker): download in safetensors format for supported models
#186
peakji
closed
1 year ago
0
Do you have Discord community?
#185
karfly
opened
1 year ago
1
build(deps): update safetensors requirement from ~=0.3.0 to ~=0.3.1
#184
dependabot[bot]
closed
1 year ago
1
Docker run runs and then exits, does not set up server
#183
handrew
opened
1 year ago
2
build(deps): update huggingface-hub requirement from ~=0.13.4 to ~=0.14.0
#182
dependabot[bot]
closed
1 year ago
1
RuntimeError: mat1 and mat2 shapes cannot be multiplied
#181
lcw99
opened
1 year ago
1
GPTQ & 4bit
#180
olihough86
opened
1 year ago
3
Support for `v1/embeddings` endpoint
#179
josephrocca
closed
1 year ago
12
build(*): bump version to 0.17.1
#178
peakji
closed
1 year ago
0
build(utils): only download weights index of the selected tensor format
#177
peakji
closed
1 year ago
0
build(*): bump version to 0.17.0
#176
orionji
closed
1 year ago
0
build(deps): add safetensors to dependencies
#175
fardeon
closed
1 year ago
1
build(utils): allow to download in safetensors format
#174
fardeon
closed
1 year ago
1
Possible to run on M-series chips/MPS?
#173
fakerybakery
closed
1 year ago
3
Add M-series/MPS support
#172
fakerybakery
closed
1 year ago
1
build(snap): permit access to gpu hardware
#171
peakji
closed
1 year ago
0
build(docker): add example for bundling stablelm-tuned-alpha-7b
#170
orionji
closed
1 year ago
0
build(docker): update example to use huggyllama/llama-7b
#169
orionji
closed
1 year ago
0
build(docker): clean up example bundles
#168
orionji
closed
1 year ago
0
build(utils): only download files for pytorch
#167
orionji
closed
1 year ago
1
test(data): remove unused weights
#166
orionji
closed
1 year ago
1
build(docker): add chat template for chatglm
#165
orionji
closed
1 year ago
1
build(docker): add chat template for stablelm
#164
fardeon
closed
1 year ago
1
feat(server): add default chat template
#163
fardeon
closed
1 year ago
1
build(*): bump version to 0.16.2
#162
fardeon
closed
1 year ago
0
build(snap): fix unbound variable
#161
peakji
closed
1 year ago
1
Vicuna problem
#160
zhound420
closed
1 year ago
13
fix(server): significantly increase the default limits
#159
peakji
closed
1 year ago
1
Question about COMPLETION_MAX_PROMPT
#158
nicpopovic
closed
1 year ago
5
build(snap): remove version prefix
#157
peakji
closed
1 year ago
1
build(snap): use git tag as snap version
#156
peakji
closed
1 year ago
0
build(*): bump version to 0.16.1
#155
peakji
closed
1 year ago
1
build(snap): simplify snap packaging workflow
#154
peakji
closed
1 year ago
0
fix(server): ignore mimetype and always try to parse request body
#153
fardeon
closed
1 year ago
1
Getting error for model when using vicuna model
#152
djaffer
closed
1 year ago
5
The requested URL was not found on the server
#151
artivis
opened
1 year ago
2
build(snap): add snap packaging
#150
artivis
closed
1 year ago
6
build(*): bump version to 0.16.0
#149
peakji
closed
1 year ago
0
feat(server): support cross-origin resource sharing
#148
peakji
closed
1 year ago
0
Any chance to support text-generation-inference as backend?
#147
hewr1993
opened
1 year ago
1
build(deps): update transformers[sentencepiece] requirement from ~=4.28.0 to ~=4.28.1
#146
dependabot[bot]
closed
1 year ago
1
Replace EventSource with POST requests in playground
#145
fardeon
opened
1 year ago
0
Previous
Next