issues
search
deepjavalibrary
/
djl-serving
A universal scalable machine learning model deployment solution
Apache License 2.0
182
stars
59
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
[serving] Update default max worker to 1 for GPU
#2048
xyang16
closed
3 weeks ago
0
[docs] Updates embedding user guide
#2047
frankfliu
closed
3 weeks ago
0
[IB] support suzuka model
#2046
lanking520
closed
3 weeks ago
0
[IB] write template into file system
#2045
lanking520
closed
3 weeks ago
0
[IB] use a file to pass to the output
#2044
lanking520
closed
3 weeks ago
0
bump up trtllm to 0.10.0
#2043
ydm-amazon
closed
1 week ago
0
[Serving] Implement SageMaker Secure Mode & support for multiple data sources
#2042
ethnzhng
closed
3 weeks ago
0
[doc] SSE jsonline document
#2041
sindhuvahinis
closed
3 weeks ago
0
[serving] Fail ping if error rate exceed
#2040
frankfliu
closed
3 weeks ago
0
[metrics] Improve prometheus metric type handling
#2039
frankfliu
closed
1 month ago
0
AutoAWQ Integration Script
#2038
a-ys
closed
3 weeks ago
1
[ci] Add back missing publish task in gradle
#2037
frankfliu
closed
1 month ago
0
[docker] Fixes docker build script for version detection
#2036
frankfliu
closed
1 month ago
0
[python] Fixes typing issue with py3.8
#2035
frankfliu
closed
1 month ago
0
[serving] Update python typing to support py38
#2034
tosterberg
closed
1 month ago
0
[test] Fixes java-client test dependency
#2033
frankfliu
closed
1 month ago
0
[doc] adding release notes for docs.djl.ai
#2032
sindhuvahinis
closed
3 weeks ago
1
[doc] add tgi_compat and see details
#2031
sindhuvahinis
closed
1 month ago
0
[CI] fix a bug in dataset prep
#2030
lanking520
closed
1 month ago
0
Updates DJL version to 0.29.0-SNAPSHOT
#2029
frankfliu
closed
1 month ago
0
[doc] improve output schema doc
#2028
sindhuvahinis
closed
1 month ago
0
Add llama-3 lora test
#2027
rohithkrn
closed
1 month ago
0
[docs] Omit response array in text embedding doc
#2026
xyang16
closed
1 month ago
0
[docs] Fix broken links in user guide
#2025
xyang16
closed
1 month ago
0
[lmi][docs] add deepspeed deprecation notice to lmi docs
#2024
siddvenk
closed
1 month ago
0
[CI] LLM Integration Tests through pytest suite
#2023
zachgk
closed
2 weeks ago
4
[doc] Add LMI Text Embedding Inference user guide
#2022
xyang16
closed
1 month ago
0
[0.28.0-dlc][cherry-pick][CI] use split by '\n' to solve the issue (#2020)
#2021
sindhuvahinis
closed
1 month ago
0
[CI] use split by '\n' to solve the issue
#2020
lanking520
closed
1 month ago
0
Add ecr login credentials
#2019
vinayburugu
closed
1 month ago
0
[doc] custom output formatter schema
#2018
sindhuvahinis
closed
1 month ago
0
[docker] Fixes duplicated onnx jar file issue
#2017
frankfliu
closed
1 month ago
0
[docker] Remove onnxruntime cpu jar in lmi docker
#2016
xyang16
closed
1 month ago
0
[0.28.0-dlc][cherry-pick] Convert cuda env tgi variables to lmi (#2013)
#2015
sindhuvahinis
closed
1 month ago
0
[lmi][docs] fix token format in api schema docs
#2014
siddvenk
closed
1 month ago
0
Convert cuda env tgi variables to lmi
#2013
sindhuvahinis
closed
1 month ago
0
Update max num tokens workflow, fix multiple bugs
#2012
ydm-amazon
closed
1 month ago
0
Refactor lmi_dist and vllm to support best_of with RequestOutput
#2011
sindhuvahinis
closed
1 month ago
2
[CI] add nvme support and update model
#2010
lanking520
closed
1 month ago
0
lmi cpu container with vLLM
#2009
lanking520
opened
1 month ago
0
[Cherrypick][docker] Install missing pytorch jni package (#2007)
#2008
lanking520
closed
1 month ago
0
[docker] Install missing pytorch jni package
#2007
frankfliu
closed
1 month ago
0
[fix] Update vllm config path for sm
#2006
maaquib
closed
1 month ago
0
Sm vllm config
#2005
maaquib
closed
1 month ago
0
[0.28.0-dlc] [tensorrt-llm] Freeze tensorrt llm toolkit versions for tensorrt llm container
#2004
ydm-amazon
closed
1 month ago
0
[docs][lmi] update lmi docs in general for 0.28.0
#2003
siddvenk
closed
1 month ago
0
[0.28.0-dlc] [tensorrt-llm] Freeze tensorrt llm toolkit versions for tensorrt llm container
#2002
ydm-amazon
closed
1 month ago
0
[docs] Update lmi-dist and vllm docs for 0.28.0 release
#2001
maaquib
closed
1 month ago
0
[serving] Fixes onnx model conversion bug
#2000
frankfliu
closed
1 month ago
0
[docs][lmi] add warning to deepspeed user guide indicating deprecated…
#1999
siddvenk
closed
1 month ago
0
Previous
Next