issues
search
hyperonym
/
basaran
Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.
MIT License
1.29k
stars
81
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
build(*): bump version to 0.21.0
#244
peakji
closed
10 months ago
1
build(deps): update safetensors requirement from ~=0.3.2 to ~=0.3.3
#243
dependabot[bot]
closed
10 months ago
0
build(deps): update transformers[sentencepiece] requirement from ~=4.31.0 to ~=4.32.0
#242
dependabot[bot]
closed
10 months ago
0
build(deps): update accelerate requirement from ~=0.20.3 to ~=0.22.0
#241
dependabot[bot]
closed
10 months ago
2
build(deps): update accelerate requirement from ~=0.20.3 to ~=0.21.0
#240
dependabot[bot]
closed
10 months ago
1
build(deps): revert accelerate requirement
#239
peakji
closed
10 months ago
1
build(deps): add scipy to dependencies
#238
peakji
closed
10 months ago
1
feat(model): add MPS support for Apple Silicon
#237
fakerybakery
closed
10 months ago
2
build(deps): update safetensors requirement from ~=0.3.1 to ~=0.3.2
#236
dependabot[bot]
closed
11 months ago
0
build(deps): update bitsandbytes requirement from ~=0.41.0 to ~=0.41.1
#235
dependabot[bot]
closed
11 months ago
1
How to send Audio Inputs to the Basaran
#234
Tushar-ml
opened
11 months ago
3
build(deps): update bitsandbytes requirement from ~=0.40.2 to ~=0.41.0
#233
dependabot[bot]
closed
11 months ago
0
Llama 2 models not working - how to pass auth token?
#232
arsaboo
opened
11 months ago
1
build(*): bump version to 0.20.0
#231
peakji
closed
11 months ago
1
build(deps): update transformers[sentencepiece] requirement from ~=4.30.2 to ~=4.31.0
#230
dependabot[bot]
closed
11 months ago
0
build(deps): update bitsandbytes requirement from ~=0.40.0 to ~=0.40.2
#229
dependabot[bot]
closed
11 months ago
1
build(deps): update accelerate requirement from ~=0.20.3 to ~=0.21.0
#228
dependabot[bot]
closed
10 months ago
0
TypeError: __init__() got an unexpected keyword argument 'load_in_4bit'
#227
tanshuai
opened
12 months ago
1
build(deps): update bitsandbytes requirement from ~=0.39.1 to ~=0.40.0
#226
dependabot[bot]
closed
11 months ago
0
build(deps): update huggingface-hub requirement from ~=0.16.3 to ~=0.16.4
#225
dependabot[bot]
closed
12 months ago
0
build(deps): update huggingface-hub requirement from ~=0.16.2 to ~=0.16.3
#224
dependabot[bot]
closed
12 months ago
0
Error when Running Vicuna's FastChat Model without GPU
#223
davyeu
closed
11 months ago
1
build(deps): update huggingface-hub requirement from ~=0.15.1 to ~=0.16.2
#222
dependabot[bot]
closed
1 year ago
1
FR support for using fine tuned models that use Peft
#221
samos123
opened
1 year ago
0
I want use the function prefix_allowed_tokens_fn, where of basaran's source code shall I modify?
#220
zoubaihan
opened
1 year ago
1
build(deps): update flask-cors requirement from ~=3.0.10 to ~=4.0.0
#219
dependabot[bot]
closed
1 year ago
0
fix(model): set model to evaluation mode
#218
peakji
closed
1 year ago
1
build(deps): update bitsandbytes requirement from ~=0.39.0 to ~=0.39.1
#217
dependabot[bot]
closed
1 year ago
1
adding auth
#216
d4v3y0rk
closed
1 year ago
0
RuntimeError: expected scalar type Float but found Half
#215
DataDropp
opened
1 year ago
0
build(deps): update transformers[sentencepiece] requirement from ~=4.30.1 to ~=4.30.2
#214
dependabot[bot]
closed
1 year ago
0
crash when running mosaicml/mpt-7b-* models: KeyError: 'attention_mask'
#213
tarasglek
opened
1 year ago
2
feat(model): pass kwargs to generate from model call
#212
creatorrr
closed
1 year ago
2
build(*): bump version to 0.19.0
#211
peakji
closed
1 year ago
1
build(deps): update transformers[sentencepiece] requirement from ~=4.30.0 to ~=4.30.1
#210
dependabot[bot]
closed
1 year ago
1
feat(model): add support for 4-bit quantization
#209
peakji
closed
1 year ago
2
build(deps): update accelerate requirement from ~=0.19.0 to ~=0.20.3
#208
dependabot[bot]
closed
1 year ago
1
build(deps): update transformers[sentencepiece] requirement from ~=4.29.2 to ~=4.30.0
#207
dependabot[bot]
closed
1 year ago
0
build(deps): update accelerate requirement from ~=0.19.0 to ~=0.20.1
#206
dependabot[bot]
closed
1 year ago
1
concurrent request supported?
#205
hudengjunai
closed
1 year ago
1
Falcon 40B : too slow and random answers
#204
ArnaudHureaux
opened
1 year ago
7
Allow loading model with BitsAndBytes 4bit quantization, PEFT LoRA adapters.
#203
idoru
opened
1 year ago
5
QLoRa support
#202
bitnom
closed
1 year ago
4
build(deps): update huggingface-hub requirement from ~=0.14.1 to ~=0.15.1
#201
dependabot[bot]
closed
1 year ago
0
build(*): bump version to 0.18.1
#200
fardeon
closed
1 year ago
1
fix(server): temporary workaround for multiple prompts
#199
fardeon
closed
1 year ago
1
Langchain Prompt Format
#198
0xDigest
opened
1 year ago
5
in stream mode, the English word has no space after detokenizer and Chinese were messed up
#197
lucasjinreal
opened
1 year ago
14
build(deps): update bitsandbytes requirement from ~=0.38.1 to ~=0.39.0
#196
dependabot[bot]
closed
1 year ago
1
build(*): bump version to 0.18.0
#195
peakji
closed
1 year ago
1
Previous
Next