issues
search
deepjavalibrary
/
djl-serving
A universal scalable machine learning model deployment solution
Apache License 2.0
183
stars
58
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
[python] Fixes typing issue with py3.8
#2035
frankfliu
closed
1 month ago
0
[serving] Update python typing to support py38
#2034
tosterberg
closed
1 month ago
0
[test] Fixes java-client test dependency
#2033
frankfliu
closed
1 month ago
0
[doc] adding release notes for docs.djl.ai
#2032
sindhuvahinis
closed
1 month ago
1
[doc] add tgi_compat and see details
#2031
sindhuvahinis
closed
1 month ago
0
[CI] fix a bug in dataset prep
#2030
lanking520
closed
1 month ago
0
Updates DJL version to 0.29.0-SNAPSHOT
#2029
frankfliu
closed
1 month ago
0
[doc] improve output schema doc
#2028
sindhuvahinis
closed
1 month ago
0
Add llama-3 lora test
#2027
rohithkrn
closed
1 month ago
0
[docs] Omit response array in text embedding doc
#2026
xyang16
closed
1 month ago
0
[docs] Fix broken links in user guide
#2025
xyang16
closed
1 month ago
0
[lmi][docs] add deepspeed deprecation notice to lmi docs
#2024
siddvenk
closed
1 month ago
0
[CI] LLM Integration Tests through pytest suite
#2023
zachgk
closed
4 weeks ago
4
[doc] Add LMI Text Embedding Inference user guide
#2022
xyang16
closed
1 month ago
0
[0.28.0-dlc][cherry-pick][CI] use split by '\n' to solve the issue (#2020)
#2021
sindhuvahinis
closed
1 month ago
0
[CI] use split by '\n' to solve the issue
#2020
lanking520
closed
1 month ago
0
Add ecr login credentials
#2019
vinayburugu
closed
1 month ago
0
[doc] custom output formatter schema
#2018
sindhuvahinis
closed
1 month ago
0
[docker] Fixes duplicated onnx jar file issue
#2017
frankfliu
closed
1 month ago
0
[docker] Remove onnxruntime cpu jar in lmi docker
#2016
xyang16
closed
1 month ago
0
[0.28.0-dlc][cherry-pick] Convert cuda env tgi variables to lmi (#2013)
#2015
sindhuvahinis
closed
1 month ago
0
[lmi][docs] fix token format in api schema docs
#2014
siddvenk
closed
1 month ago
0
Convert cuda env tgi variables to lmi
#2013
sindhuvahinis
closed
1 month ago
0
Update max num tokens workflow, fix multiple bugs
#2012
ydm-amazon
closed
1 month ago
0
Refactor lmi_dist and vllm to support best_of with RequestOutput
#2011
sindhuvahinis
closed
1 month ago
2
[CI] add nvme support and update model
#2010
lanking520
closed
1 month ago
0
lmi cpu container with vLLM
#2009
lanking520
opened
1 month ago
0
[Cherrypick][docker] Install missing pytorch jni package (#2007)
#2008
lanking520
closed
1 month ago
0
[docker] Install missing pytorch jni package
#2007
frankfliu
closed
1 month ago
0
[fix] Update vllm config path for sm
#2006
maaquib
closed
1 month ago
0
Sm vllm config
#2005
maaquib
closed
1 month ago
0
[0.28.0-dlc] [tensorrt-llm] Freeze tensorrt llm toolkit versions for tensorrt llm container
#2004
ydm-amazon
closed
1 month ago
0
[docs][lmi] update lmi docs in general for 0.28.0
#2003
siddvenk
closed
1 month ago
0
[0.28.0-dlc] [tensorrt-llm] Freeze tensorrt llm toolkit versions for tensorrt llm container
#2002
ydm-amazon
closed
1 month ago
0
[docs] Update lmi-dist and vllm docs for 0.28.0 release
#2001
maaquib
closed
1 month ago
0
[serving] Fixes onnx model conversion bug
#2000
frankfliu
closed
1 month ago
0
[docs][lmi] add warning to deepspeed user guide indicating deprecated…
#1999
siddvenk
closed
1 month ago
0
[0.28.0-dlc][dlc] Update tag versions for containers
#1998
tosterberg
closed
1 month ago
0
[0.28.0-dlc][lmi] freeze versions for LMI Dist
#1997
tosterberg
closed
1 month ago
0
[0.28.0-dlc][lmi-dist] Freeze version for LMI Dist
#1996
maaquib
closed
1 month ago
1
[0.28.0-dlc][tnx] freeze versions for LMI Neuron
#1995
tosterberg
closed
1 month ago
0
fix typo in finish_reason default.
#1994
sindhuvahinis
closed
1 month ago
0
[vLLM] support future arctic model FP8 quantization
#1993
lanking520
closed
1 month ago
0
best_of support in output formatter
#1992
sindhuvahinis
closed
1 month ago
0
[fix] Seq2Seq model fix for lmi-dist
#1991
maaquib
closed
1 month ago
0
[docs] Update trtllm docs for 0.28.0
#1990
ydm-amazon
closed
1 month ago
0
Adds SECURITY.md file
#1989
zachgk
closed
1 month ago
0
Add tensorrt_llm libs to LD_LIBRARY_PATH
#1988
nskool
closed
1 month ago
0
[ci] Remove remote code and use latest transformers for falcon
#1987
maaquib
closed
1 month ago
0
[0.28.0-dlc] [fix] Fix arguments null pointer
#1986
xyang16
closed
1 month ago
0
Previous
Next