pytorch serve issues - Githubissues

pytorch / serve

Serve, optimize and scale PyTorch models in production

https://pytorch.org/serve/

Apache License 2.0

4.04k stars 820 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Revert "Kserve fix ray & setuptools dependency issue"

#3208 udaij12 opened 1 hour ago
0
Kserve ray and setuptools dependency fix

#3207 udaij12 opened 1 hour ago
0
Docker swarm with TorchServe workflow

#3206 KD1994 opened 2 hours ago
0
Kserve fix ray & setuptools dependency issue

#3205 udaij12 closed 20 hours ago
1
WARNING: sun.reflect.Reflection.getCallerClass is not supported. This will impact performance.

#3204 aalbersk opened 2 days ago
0
TensorRT example with torch.compile

#3203 agunapal closed 15 hours ago
0
torchserve bloom7b1 demo Load model failed

#3202 zqc2011hy opened 4 days ago
2
BERT with torch.compile

#3201 agunapal opened 4 days ago
0
Update image_classifier/densenet-161 to include torch.compile

#3200 lzcemma closed 4 days ago
1
Handling of subsequent RegisterModel calls to Management gRPC endpoint with same model & version

#3199 mihaidusmanu opened 5 days ago
0
Fix sequence continuous batching close session race condition

#3198 namannandan closed 4 days ago
0
Benchmark numpy fix

#3197 udaij12 closed 5 days ago
0
Kserve ci fix

#3196 udaij12 closed 6 days ago
0
How to send a torch array via request

#3195 lschaupp closed 6 days ago
4
Fixing docker CI

#3194 udaij12 closed 1 week ago
0
Locust monkey patching leads to test cross-talking

#3193 mreso opened 1 week ago
0
Token Authorization fixes

#3192 udaij12 closed 1 week ago
0
Worker dead and yet describe_model gives me `worker.status: Ready`

#3191 MohamedAliRashad opened 1 week ago
0
workaround for compile example failure

#3190 agunapal closed 1 week ago
0
pytest: test_example_torch_compile.py is faling

#3189 agunapal opened 1 week ago
1
Updating night CIs to account for model control and token auth

#3188 udaij12 closed 1 week ago
0
Replace pkg_resources.packaging

#3187 udaij12 closed 6 days ago
0
Running segment_anything_fast example locally

#3186 yousofaly opened 2 weeks ago
1
Follow up on token authentication PR comments

#3185 mreso opened 2 weeks ago
5
[RFC] Token Authorization by default

#3184 udaij12 opened 2 weeks ago
0
Security documentation update

#3183 udaij12 opened 2 weeks ago
0
Add support for hpu_backend and Resnet50 compile example

#3182 wozna closed 2 days ago
2
"Token Authorization" for gRPC

#3181 udaij12 opened 2 weeks ago
0
"Model mode control" for gRPC

#3180 udaij12 opened 2 weeks ago
0
Fixing torch compile benchmark

#3179 udaij12 closed 2 weeks ago
1
Replace pkg_resources.packaging with packaging module

#3178 namannandan closed 1 week ago
2
Fix Inf2 benchmark

#3177 namannandan closed 2 weeks ago
0
ImportError: cannot import name 'packaging' from 'pkg_resources'

#3176 Sieltek opened 3 weeks ago
4
Changing mar file for Bert torch compile

#3175 udaij12 closed 3 weeks ago
0
Enable pytest test_torch_compile.py: test_serve_inference

#3174 agunapal closed 1 week ago
1
Enable pytest test_example_torch_compile.py:test_example_torch_compile.py

#3173 agunapal closed 1 week ago
1
Two-way authentication/Mutual SSL in gRPC

#3172 MohamedAliRashad opened 3 weeks ago
0
Bump twine from 4.0.2 to 5.1.0

#3171 dependabot[bot] closed 22 hours ago
0
Bump pyyaml from 6.0 to 6.0.1

#3170 dependabot[bot] closed 22 hours ago
0
Bump io.netty:netty-all from 4.1.107.Final to 4.1.110.Final in /plugins

#3169 dependabot[bot] opened 3 weeks ago
0
The service crashes if the model takes a long time to respond

#3168 yurkoff-mv opened 3 weeks ago
6
NotImplementedError: Cannot copy out of meta tensor; no data! + Models not generating output text

#3167 bjorquera1 opened 3 weeks ago
0
torch compile config standardization update

#3166 agunapal closed 2 weeks ago
0
Adding model-control-mode

#3165 udaij12 closed 2 weeks ago
0
Standardize PyTorch 2.x features config in model-config.yaml

#3164 agunapal closed 1 week ago
1
Enable Token Authorization by default

#3163 udaij12 closed 1 week ago
3
Make torchserve-kfs docker image multiplatform

#3162 DanielTemesgen opened 1 month ago
1
Make torchserve-kfs docker image multiplatform

#3161 DanielTemesgen opened 1 month ago
0
Support continuous batching in sequence batch streaming case

#3160 lxning closed 3 weeks ago
0
Update performance documentation

#3159 agunapal closed 3 weeks ago
0