allegroai clearml-serving issues

allegroai / clearml-serving

ClearML - Model-Serving Orchestration and Repository Solution

https://clear.ml

Apache License 2.0

138 stars 40 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Add unload method to preprocess; restart on crashes

#80 eugen-ajechiloae-clearml opened 1 month ago
0
Allow specifying python version for Dockerfile

#79 imadassamani opened 1 month ago
0
Cuda oom handler [continuation]

#78 IlyaMescheryakov1402 opened 2 months ago
0
Deploy YOLOv8 Segmentation model

#77 Flippchen opened 3 months ago
0
added exit-on-error option for tritonserver.

#76 stephanbertl closed 3 months ago
0
Adding clearml_serving_inference restart on CUDA OOM

#75 IlyaMescheryakov1402 closed 3 months ago
0
[clearml-serving] Specification of model platform not possible

#74 ockaro opened 6 months ago
3
Can not run Toy model (scikit learn) deployment example

#73 david101-hunter opened 6 months ago
0
[Bug] Run clearml serving with clearml server not working

#72 david101-hunter opened 6 months ago
2
Could not download model in triton container

#71 IlyaMescheryakov1402 opened 6 months ago
1
Multiple TensorRT handling(plan file per gpu)

#70 TDNAI closed 8 months ago
0
Removing model monitoring in endpoint

#69 imadassamani opened 8 months ago
1
Shared functions across preprocess file

#68 amirhmk opened 10 months ago
2
Fix incorrect requests version specifier in requirements.txt

#67 ilyahabr closed 8 months ago
0
Incorrect requests version specifier in requirements.txt

#66 ilyahabr closed 8 months ago
3
serving stuck because of deleted model

#65 stephanbertl opened 10 months ago
0
torchserve support?

#64 k-sokolov opened 10 months ago
2
Docker image not up-to-date

#63 amirhmk opened 11 months ago
1
Error during creation endpoints with config.pbtxt

#62 IlyaMescheryakov1402 closed 9 months ago
4
ValueError: dictionary update sequence element #0 has length <>; 2 is required

#61 IlyaMescheryakov1402 closed 1 year ago
2
triton model breaks serving instance

#60 stephanbertl closed 3 months ago
4
Fix Slack link

#58 pollfly closed 10 months ago
0
Where to find logging for preprocessing Custom model

#57 fulankun1412 opened 1 year ago
2
Error: Failed loading preprocess code for '<>': No module named 'transformers'

#56 IlyaMescheryakov1402 closed 1 year ago
1
Await async Triton process

#55 amirhmk closed 1 year ago
0
String not supported for Triotn

#54 amirhmk opened 1 year ago
1
Unable to load onnx models into Triton

#53 amirhmk opened 1 year ago
7
[DRAFT]: Pass Triton Config Directly

#52 amirhmk closed 1 year ago
0
Use python 3.8 in serving container

#51 milongo closed 3 months ago
6
Removes unnessary flatten

#50 amirhmk closed 1 year ago
1
Configure options for gRPC (Triton server)

#49 amirhmk closed 1 year ago
3
Incorrect shape size PyTorch

#48 amirhmk closed 1 year ago
2
changed np.bool deprecated in numpy 1.20.0, changed to bool

#47 anon-it closed 1 year ago
2
AttributeError: module 'numpy' has no attribute 'int'

#46 galleon closed 1 year ago
2
added environment vars for advanced usage

#45 besrym closed 1 year ago
4
Unable to canonicalize address from Kafka

#44 amirhmk opened 1 year ago
3
Deploying Models from Azure Blob

#43 ockaro opened 1 year ago
5
Remove never-used but now deprecated np.int

#42 thepycoder closed 1 year ago
0
clearml-serving not working with newer numpy 1.24

#41 cajewsa closed 1 year ago
4
better explanation of the scalar type and buckets

#40 besrym closed 1 year ago
2
AWS S3 storage driver (boto3) not found

#39 vladseve7n opened 1 year ago
7
Issue with pytorch preprocess code

#38 okyspace opened 1 year ago
1
Bytes request payload

#37 Aleksandar1932 closed 2 years ago
2
Triton server keeps crashing

#36 Aleksandar1932 closed 1 year ago
3
Inconsistent inference results from clearml-serving

#35 Muscle-Oliver opened 2 years ago
1
Serving autoscaling strategy

#34 senysenyseny16 closed 1 year ago
2
Serving with custom engine

#33 Bunoviske closed 2 years ago
3
Endpoint authorization with API key

#32 Bunoviske closed 2 years ago
4
Endpoint model name revision

#31 Acexoul081 closed 2 years ago
0
add aux-config parser error

#30 andycancado closed 2 years ago
2