issues
search
pytorch
/
serve
Serve, optimize and scale PyTorch models in production
https://pytorch.org/serve/
Apache License 2.0
4.22k
stars
863
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Quickstart vLLM examples do not work as expected
#3365
prashant-warrier-echelonvi
opened
5 days ago
0
Unable to build frontend after following the documentation
#3364
mihaidusmanu
opened
1 week ago
0
Fix frontend readme
#3363
mihaidusmanu
opened
1 week ago
0
Trying to find a doc explaining how the scaling works (min_worker to max_worker)
#3362
lschaupp
opened
1 week ago
0
Issue when sending parallel requests
#3361
lschaupp
opened
2 weeks ago
0
`weights_only` default flip for `torch.load`
#3360
mikaylagawarecki
opened
2 weeks ago
0
Low Throughput and High Latency with TorchServe Deployment on AWS
#3359
dummyuser-123
opened
2 weeks ago
0
Model & Instance scaling
#3358
markcNewell
opened
2 weeks ago
0
413 Request Entity Too Large
#3357
pengxin233
opened
2 weeks ago
0
Adding Multi-Image generation usecase app
#3356
ravi9
opened
2 weeks ago
0
feature/add torchserve detectron2
#3355
Mudassar-MLE
opened
2 weeks ago
0
Bump onnx from 1.16.0 to 1.17.0 in /requirements
#3354
dependabot[bot]
closed
1 month ago
0
Allow to provide custom model_service_worker.py
#3353
racinmat
opened
1 month ago
0
GPU not detected inside torchserve docker container
#3352
dummyuser-123
closed
1 month ago
1
feat: making torchserve usable without torch
#3351
racinmat
opened
1 month ago
1
Make TorchServe usable without torch installed
#3350
racinmat
opened
1 month ago
0
Error in MetricCollector when starting pytorch/torchserve:0.12.0-gpu container
#3349
Hspix
opened
1 month ago
0
Getting started guide client samples broken ?
#3348
nikste
opened
1 month ago
0
🚀 Add TensorRT Execution Provider Support in ONNX Runtime Setup
#3347
yhna940
opened
1 month ago
0
✨ Add `.devcontainer` Configuration for TorchServe Development Environment
#3346
yhna940
opened
1 month ago
3
Torchserve not starting for diffusers example
#3345
dummyuser-123
closed
1 month ago
10
Add Detectron2 Support to TorchServe Object Detection Examples
#3344
Mudassar-MLE
opened
1 month ago
2
Update vllm to 0.6.2
#3343
mreso
opened
1 month ago
0
Respond status 429 Too Many Requests instead of broad Internal Server Error
#3342
tysg
closed
1 month ago
2
fix: kservev2 batching issue and missing parameters
#3341
pkluska
opened
1 month ago
1
Fix/llm launcher model snapshot path
#3340
mreso
closed
1 month ago
1
Clarification on minWorkers and maxWorkers parameters
#3339
krzwaraksa
opened
1 month ago
0
throughput increase non-linearly with number of workers
#3338
vandesa003
opened
1 month ago
2
bug fix for llm launcher
#3337
agunapal
closed
1 month ago
1
set model_snapshot_path to None to prevent unbound local error
#3336
johnathanchiu
closed
1 month ago
2
UnboundLocalError: local variable 'model_snapshot_path' referenced before assignment
#3335
johnathanchiu
closed
1 month ago
0
Bump io.netty:netty-all from 4.1.107.Final to 4.1.114.Final in /plugins
#3334
dependabot[bot]
opened
1 month ago
0
Bump commons-io:commons-io from 2.16.1 to 2.17.0 in /frontend
#3333
dependabot[bot]
opened
1 month ago
0
allow python version=3.12 in docker script build_image.sh
#3332
fabridamicelli
opened
1 month ago
1
Create export path if not present
#3331
mreso
closed
1 month ago
0
Rename vllm dockerfile
#3330
mreso
closed
2 months ago
0
Load all models including targz
#3329
m10an
closed
2 months ago
1
fix for snapshot variables missing/null
#3328
udaij12
closed
2 months ago
0
Fix Dockerfile fore renamed forks
#3327
mreso
closed
2 months ago
0
Clear up neuron cache
#3326
chen3933
closed
2 months ago
0
Kserve management api for registering new models
#3325
matej14086
opened
2 months ago
0
"TorchServe Fails to Reload Models from S3 After k8s Pod Restart"
#3324
koscevicb
opened
2 months ago
1
Docker aarch
#3323
udaij12
closed
2 months ago
1
Fix typo: vesion -> version, succsesfully -> successfully
#3322
tadayosi
closed
2 months ago
3
Bump vllm from 0.5.0 to 0.5.5 in /examples/large_models/vllm
#3321
dependabot[bot]
closed
2 months ago
0
Allow .tar.gz models to be loaded using load_models=all
#3320
m10an
closed
2 months ago
2
Fixing kserve nightly for arm64
#3319
udaij12
closed
2 months ago
0
Update TS version to 0.12.0
#3318
agunapal
closed
2 months ago
0
docs: update WaveGlow links
#3317
emmanuel-ferdman
closed
2 months ago
0
Benchmark fix
#3316
udaij12
closed
2 months ago
0
Next