issues
search
theroyallab
/
tabbyAPI
An OAI compatible exllamav2 API that's both lightweight and fast
GNU Affero General Public License v3.0
503
stars
67
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
[REQUEST] Automatic Model Unloading while idling
#216
TetrisBlack
opened
2 days ago
2
[BUG] After fasttensors was removed, the memory usage seemed abnormal.
#215
Pevernow
opened
2 days ago
8
Docs
#214
SecretiveShell
opened
4 days ago
0
Pydantic config p2
#213
SecretiveShell
opened
5 days ago
0
[REQUEST] Add support for new output formatter Formatron
#212
saturosfz
opened
6 days ago
1
[REQUEST] Better Infinity Embeddings support
#211
arbi-dev
opened
1 week ago
0
[BUG] Batch not working, all requests sequential?
#210
SinanAkkoyun
closed
1 week ago
2
[BUG] Draft model section not being read in config.yml
#209
atisharma
closed
1 week ago
2
fix config file loader
#208
SecretiveShell
closed
1 week ago
0
[REQUEST] Support for OpenAI Message Object Content Array
#207
strikeoncmputrz
closed
1 week ago
6
Add health check monitoring for EXL2 errors
#206
SecretiveShell
closed
1 week ago
0
[BUG]docker cannot found cuda-toolkit
#205
ultranationalism
closed
1 week ago
1
fix issues with optional dependencies
#204
SecretiveShell
closed
2 weeks ago
0
[BUG] TabbyAPI uses 100% of a CPU core after a request failed due to excessively long prompt
#203
NeoChen1024
closed
1 week ago
1
Exceptions when shutting down with no model loaded
#202
awatuna
opened
2 weeks ago
2
Fix LMFE
#201
bdashore3
closed
2 weeks ago
0
[BUG] Lack of documentation/unable to use JSON/Grammar
#200
fullstackwebdev
closed
2 weeks ago
2
Refactor the sampling class
#199
SecretiveShell
opened
3 weeks ago
0
[BUG] v1/template/switch is broken
#198
SecretiveShell
closed
3 weeks ago
1
Fix tabby_config.py _from_file
#197
atisharma
closed
3 weeks ago
0
[BUG] 'TabbyConfig' object has no attribute 'from_file'. Did you mean: '_from_file'?
#196
atisharma
closed
3 weeks ago
2
Properly specify config "inline_model_loading" value in the error message
#195
Cohee1207
closed
3 weeks ago
0
add static type checker to dev environment
#194
SecretiveShell
opened
3 weeks ago
0
WIP - Tool Implementation improvements™️
#193
gittb
opened
3 weeks ago
0
debloat docker build
#192
SecretiveShell
closed
3 weeks ago
0
fix function arguments for get_model_list
#191
SecretiveShell
closed
3 weeks ago
0
rewrite API keys implementation
#190
SecretiveShell
opened
3 weeks ago
0
Pydantic config
#189
SecretiveShell
closed
2 weeks ago
0
[REQUEST] Tensor-parallel support for Gemma2ForCausalLM
#188
Abdulhanan535
closed
2 weeks ago
2
Very Strange OOM errors across multiple GPU's. OOM's, BSOD's, extreme driver crashesh all stemming from TabbyAPI
#187
SytanSD
opened
4 weeks ago
6
[REQUEST] Make docker build action faster
#186
bdashore3
opened
4 weeks ago
4
Refactor config loading
#185
SecretiveShell
closed
4 weeks ago
3
Complete conditional infinity import TODO
#184
SecretiveShell
closed
4 weeks ago
2
Override default model load parameters via yaml
#183
bdashore3
closed
1 month ago
0
[REQUEST] Update the docker section in the wiki
#182
AmgadHasan
closed
4 weeks ago
1
feat: initial support for allowed token IDs
#181
AlpinDale
closed
1 month ago
0
make docker-compose use prebuilt images
#180
SecretiveShell
closed
4 weeks ago
0
[BUG] Completitions are broken
#179
TyraVex
closed
2 weeks ago
13
Add healthcheck
#178
SecretiveShell
closed
1 month ago
4
[BUG] After updating to exllamav2-0.1.9 (from 0.1.8) cannot load Mistral Large 2 123B with a draft model
#177
Lissanro
closed
1 month ago
9
[BUG] Tabby Logs Prompts When `prompt: False`
#176
strikeoncmputrz
closed
1 month ago
2
Model: Fix draft model loading
#175
veden
closed
1 month ago
1
Remove rouge print statements within chat_completion.py
#174
gittb
closed
1 month ago
0
Tensor p
#173
bdashore3
closed
1 month ago
0
[BUG] tool calling is not working
#172
royallavanya140
closed
1 month ago
6
Build and push docker image
#171
AmgadHasan
closed
1 month ago
10
[REQUEST] Health check endpoint
#170
Immortalin
closed
1 month ago
1
[BUG] docker-compose invalid after latest change
#169
sab666
closed
1 month ago
7
[BUG] embedding models: TypeError: SentenceTransformer.__init__() got an unexpected keyword argument 'model_kwargs'
#168
BarfingLemurs
closed
1 month ago
2
[BUG] Failed to import chat template fron `config.json`
#167
Orion-zhen
closed
1 month ago
3
Next