issues
search
Lightning-AI
/
LitServe
Lightning-fast serving engine for any AI model of any size. Flexible. Easy. Enterprise-scale.
https://lightning.ai/docs/litserve
Apache License 2.0
2.5k
stars
158
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Add request queue to callbacks
#316
vrdn-23
closed
1 month ago
11
format example usage for `dockerize` CLI
#315
aniketmaurya
closed
1 month ago
1
Pyright linting fixes
#314
grumpyp
closed
1 month ago
2
add Ethan as codeowner
#313
aniketmaurya
closed
1 month ago
1
update `dockerize` CLI success msg copy
#312
aniketmaurya
closed
1 month ago
1
Enable gpu docker image generation
#311
aniketmaurya
closed
1 month ago
2
Pyright issues [Name mismatches]
#310
grumpyp
closed
1 month ago
2
switch to `argparse` for CLI
#309
aniketmaurya
closed
1 month ago
3
add codeowners for requirements
#308
aniketmaurya
closed
1 month ago
1
Dynamically grab port number
#307
grantgasser
closed
1 month ago
4
add jsonargparse in requirements
#306
aniketmaurya
closed
1 month ago
1
Embedding model support with openai spec
#305
riyajatar37003
opened
1 month ago
15
Add Keep-Alive Functionality for GPU Resource Optimization in LitServe
#304
skyking363
opened
1 month ago
12
fix vLLM capitalization
#303
aniketmaurya
closed
1 month ago
1
fix custom HTTPException with argument names
#302
aniketmaurya
closed
1 month ago
1
Custom HTTPException Not Working as Expected
#301
randydl
closed
1 month ago
3
Add warning for unexpected model output in batched prediction
#300
grumpyp
closed
1 month ago
1
update ask a question link to reddit
#299
aniketmaurya
closed
1 month ago
1
generate Dockerfile with CLI
#298
aniketmaurya
closed
1 month ago
7
update PR template with hiding instructions
#297
Borda
closed
1 month ago
1
add links to forum and reduce opening issues for docs
#296
Borda
closed
1 month ago
1
docs: update feat template / readability
#295
Borda
closed
1 month ago
1
unexpected output for HF model with matching
#294
Borda
closed
1 month ago
5
dry run after server started
#293
Borda
opened
1 month ago
1
terminate early if accelerator is missing
#292
Borda
closed
2 days ago
1
monitor and restart Logger process
#291
aniketmaurya
closed
1 month ago
2
Feat: decode request in threadpool
#290
deependujha
closed
1 month ago
6
Handle case when Logger.process is stuck
#289
aniketmaurya
opened
2 months ago
0
fix flaky Logger test
#288
aniketmaurya
closed
2 months ago
1
handle exceptions for logger processing
#287
aniketmaurya
closed
2 months ago
1
Example in documentation on how to setup an OpenAI-spec API with LlamaIndex-RAG
#286
PierreMesure
closed
2 months ago
4
fix: callbacks EventType typo
#285
aniketmaurya
closed
2 months ago
1
[Feat]: add Logger API
#284
aniketmaurya
closed
2 months ago
6
add streaming no-batch speed test
#283
aniketmaurya
closed
2 months ago
1
More complex model management (multiple models, model reloading etc...)
#282
bsergean
closed
1 month ago
2
[Chore] rename setup_server to register_endpoints
#281
aniketmaurya
closed
2 months ago
1
add Pixtral multi-modal example
#280
aniketmaurya
closed
2 months ago
1
minor LitServer code clean up
#279
aniketmaurya
closed
2 months ago
1
Callback system v0
#278
aniketmaurya
closed
2 months ago
2
chore: adds Parler TTS Studio example
#277
bhimrazy
closed
2 months ago
1
Feat: multiple endpoints using a list of LitServer
#276
bhimrazy
opened
2 months ago
6
Add Support to Huggingface Diffusers!
#275
KaifAhmad1
closed
2 months ago
2
install uvloop with uvcorn
#274
aniketmaurya
closed
2 months ago
1
Can't appear to load the server
#273
B-M-S-West
closed
2 months ago
2
Supporting query params alongside file upload
#272
energydrink9
closed
2 months ago
4
Is it possible to support multiple endpoints for one server?
#271
arkohut
opened
2 months ago
17
Feature Request: Customize FastAPI Metadata
#270
bhimrazy
opened
2 months ago
5
add perf test CI 1/3
#269
aniketmaurya
closed
2 months ago
1
ci: drop dependabot
#268
Borda
closed
2 months ago
1
If `workers_per_device` is set to 1, how can I set a model instance to be able to concurrency?
#267
ALEXuH
closed
2 months ago
8
Previous
Next