deepjavalibrary djl-serving issues

deepjavalibrary / djl-serving

A universal scalable machine learning model deployment solution

Apache License 2.0

182 stars 59 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

[python] log exception stacktrace for exceptions in python, improve r…

#2142 siddvenk opened 22 minutes ago
0
[ci] Adds formatShell gradle tasks

#2141 frankfliu closed 1 hour ago
0
[docker] Fixes docker -SNAPSHOT version build issue

#2140 frankfliu closed 5 hours ago
0
[docker] Fixes pytorch-gpu docker build script

#2139 frankfliu closed 6 hours ago
0
[docker] Fixes cpu-full docker build script

#2138 frankfliu closed 23 hours ago
0
[onnx] Allows to customize onnxruntime optimization level

#2137 frankfliu closed 23 hours ago
0
[docker] remove tensorflow native from cpu-full image

#2136 frankfliu closed 1 day ago
0
[awscurl] Fixes missing \"text\" case in jsonlines output

#2135 frankfliu closed 1 day ago
0
[CI] Add trust remote code option in TRTLLM CI

#2134 ydm-amazon closed 4 days ago
2
[cherry-pick] [secure-mode] add per-model configs to allowlist (#2132)

#2133 siddvenk closed 4 days ago
0
[secure-mode] add per-model configs to allowlist

#2132 ethnzhng closed 4 days ago
0
[ci] remove HF_MODEL_ID env for lmi_dist_1 test

#2131 sindhuvahinis closed 4 days ago
0
[secure-mode] Add properties allowlist validation (#2129)

#2130 frankfliu closed 4 days ago
0
[secure-mode] Add properties allowlist validation

#2129 ethnzhng closed 4 days ago
1
[0.28.0-dlc] spec decoding cache dirty fix

#2128 sindhuvahinis closed 4 days ago
0
[docs]Update DJL-Serving Read Me

#2127 Varun-Dutta closed 4 days ago
0
[serving] Fixes snake case pattern (#2123)

#2126 frankfliu closed 4 days ago
0
Support multi node for lmi-dist

#2125 xyang16 opened 4 days ago
0
[lmi][hf]remove usage of HF Conversational pipeline as it is deprecated

#2124 siddvenk closed 4 days ago
0
[serving] Fixes snake case pattern

#2123 frankfliu closed 4 days ago
0
[python] add support for 3p use-case

#2122 siddvenk closed 6 hours ago
1
[docker] Fixes onnxruntime engine installation

#2121 frankfliu closed 4 days ago
0
[awscurl] Handles Bedrock special url case

#2120 frankfliu closed 4 days ago
0
[docker] Update DJL to 0.29.0-SNAPSHOT

#2119 frankfliu closed 4 days ago
0
update flags to prevent deprecation

#2118 lanking520 closed 4 days ago
0
[cherrypick][0.28.0 dlc] fix default behavior for rb in neuron (#2116)

#2117 tosterberg closed 4 days ago
0
[fix] align default neuron behavior between model server and handler

#2116 tosterberg closed 5 days ago
0
[Neo] Fixing various Neo compilation/quantization script bugs

#2115 a-ys opened 5 days ago
0
[serving] make http response codes configurable for exception cases

#2114 siddvenk closed 5 days ago
0
[serving] introduce interface to customize http response status retur…

#2113 siddvenk closed 5 days ago
1
Fix acceptance history check in speculative telemetry

#2112 zachgk closed 5 hours ago
1
[CI] fix bugs

#2111 lanking520 closed 6 days ago
0
[0.28.0] fix telemetry tracking for Speculative Decoding

#2110 lanking520 closed 6 days ago
0
[CI] Integration tests through pytest

#2109 zachgk opened 6 days ago
0
[ci] Fix gpt2 integ test failure

#2108 maaquib closed 6 days ago
0
[0.26.0-dlc] pin datasets version in tensorrt llm

#2107 sindhuvahinis closed 6 days ago
0
[0.27.0-dlc] pin datasets version in tensorrt llm

#2106 sindhuvahinis closed 6 days ago
0
[0.28.0-dlc][cherry-pick][dockerfile] pin datasets to 2.19.1 in trtllm (#2104)

#2105 sindhuvahinis closed 6 days ago
0
[dockerfile] pin datasets to 2.19.1 in trtllm

#2104 sindhuvahinis closed 1 week ago
0
[0.28.0-dlc][cherry-pick][fix] Set tokenizer on output_formatter for TRT-LLM Handlers (#2100)

#2103 sindhuvahinis closed 1 week ago
0
[ci] add trtllm chat test

#2102 sindhuvahinis closed 1 week ago
0
[ci] fix pinning numpy inf2 error

#2101 tosterberg closed 1 week ago
0
[fix] Set tokenizer on output_formatter for TRT-LLM Handlers

#2100 maaquib closed 1 week ago
2
[Draft][Do-not-merge] 0.28.0 multi node initial changes

#2099 nskool opened 1 week ago
0
[ci] fix trtllm nightly wheel pip installs

#2098 tosterberg closed 1 week ago
0
[ci] fix ground truth for neuron unit test

#2097 tosterberg closed 1 week ago
0
[ci] fix nightly wheel pip installs

#2096 tosterberg closed 1 week ago
0
[Neuron] Fix Neuron compilation logging

#2095 a-ys closed 1 week ago
0
[0.28.0-dlc] Record telemetry including acceptance rate

#2094 zachgk closed 1 week ago
0
Llama 2 7b chat model output quality is low

#2093 VrushaliJoshi-v37040 opened 1 week ago
4