issues
search
Preemo-Inc
/
text-generation-inference
Apache License 2.0
201
stars
22
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
update causal batch for ct2 and fix nf4
#17
michaelfeil
closed
6 months ago
5
Mistral Models ct2 support
#16
manishiitg
opened
11 months ago
1
Update Readme.md / documentation
#15
michaelfeil
closed
11 months ago
0
Add logit_bias (SequenceBiasLogitsProcessor)
#14
Stealthwriter
opened
1 year ago
0
Initialize v_cache to avoid NaNs
#12
Atry
closed
1 year ago
0
fix: initialize v_cache to avoid NaNs
#11
Atry
closed
1 year ago
1
Compilation fix: Correct method argument types in generation.rs and validation.rs
#10
sunapi386
closed
1 year ago
1
Incorrect method argument types in generation.rs and validation.rs
#9
sunapi386
closed
1 year ago
1
AWQ support
#8
casper-hansen
opened
1 year ago
2
Claim copyright
#7
Atry
closed
1 year ago
1
fix(bloom): don't enable custom kernels if CUDA is not available
#6
Atry
closed
1 year ago
0
refactor(server): Add `AutoCausalLM` to avoid skipping `CausalLM`'s constructor
#5
Atry
closed
1 year ago
3
4bit quantization with bitsandbytes
#4
michaelfeil
closed
12 months ago
6
Add a new README
#3
Atry
closed
1 year ago
0
Wrapping completions and chat/completions endpoint
#2
michaelfeil
closed
11 months ago
11
Adding ctranslate2 quantization and inference: moving the contribution
#1
michaelfeil
closed
11 months ago
16