awslabs multi-model-server issues

awslabs / multi-model-server

Multi Model Server is a tool for serving neural net models for inference

Apache License 2.0

998 stars 230 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

update netty version to 4.1.109.Final

#1028 lxning closed 6 months ago
0
Make healthcheck dependent on models loaded

#1027 wojciechrauk-plutoflume opened 7 months ago
1
Bump gevent from 20.5.2 to 23.9.1 in /tests/performance

#1026 dependabot[bot] opened 1 year ago
0
MMS Server getting stuck while registering the model and says "worker pid is not available yet"

#1025 suchith-sixsense opened 1 year ago
0
Update buildspec.yml

#1024 AnupamAS0x1 closed 1 year ago
0
Update buildspec.yml

#1023 AnupamAS0x1 closed 1 year ago
0
How to handle invalid input!

#1022 xuweidongkobe opened 1 year ago
1
Update version.py

#1021 davidthomas426 closed 1 year ago
0
Update version.py

#1020 davidthomas426 closed 1 year ago
0
Add config for request timeout in seconds

#1019 davidthomas426 closed 1 year ago
0
Upgrade gson to 2.8.9

#1018 c2zwdjnlcg closed 1 year ago
0
Overriding the model routing logic

#1017 James-UnlikelyAI opened 1 year ago
0
readAddress(..) failed: Connection reset by peer

#1016 xuweidongkobe opened 1 year ago
1
Upgrade netty to 4.1.91.Final

#1015 c2zwdjnlcg closed 1 year ago
0
Update documentation to establish the difference between backend time and backend response time

#1014 sachanub opened 1 year ago
0
Handled error to return the reason of failure as part of the response.

#1013 shamika opened 1 year ago
0
Streaming support on MMS

#1012 rauldiaz opened 1 year ago
1
Log model loading exception to assist with debugging

#1011 namannandan closed 1 year ago
0
Improve MMS model loading exception handling

#1010 namannandan closed 1 year ago
0
Config option to increase or disable model load timeout

#1009 svenkata9 opened 1 year ago
1
Fix misnamed model_url query parameter in openapi docs

#1008 mulhod opened 1 year ago
0
Invalid Response Headers Set for Non MME Inference Scenario (scikit learn container)

#1007 Grassycup opened 2 years ago
0
Explicitly terminate process in sigterm_handler

#1006 nikhil-sk opened 2 years ago
0
Validate MMS process during start

#1005 nikhil-sk opened 2 years ago
0
Model specific custom python package installation

#1004 salvadiswar02 opened 2 years ago
0
python version

#1003 n0thing233 opened 2 years ago
1
Add support for detecting the number of available Neuron cores

#1002 aws-taylor opened 2 years ago
1
Preloading models on Sagemaker multi-model endpoint doesn't work

#1001 sassarini-marco opened 2 years ago
0
Is it supporting Apple M1 Chip ?

#1000 jaiswalvineet opened 2 years ago
0
Issue: Memory Leak when serving multiple models

#999 pratikluitel opened 2 years ago
4
mms-gpu - cuda error - No kernel image is available for execution on the device

#998 kaushal-idx closed 2 years ago
0
how to change url format

#997 xuweidongkobe opened 2 years ago
0
Question: Can I use cuda 11, for gpu inference on mms

#996 kaushal-idx closed 2 years ago
4
Provide more information in job queue error and docs

#995 nikhil-sk closed 2 years ago
0
log4j2 metrics JsonLayout / QLogLayout logger broken

#994 lxning opened 2 years ago
0
command not found: multi-model-server

#993 nimafo opened 2 years ago
1
`com.amazonaws.ml.mms.metrics.MetricCollector - java.io.IOException: Broken pipe` and `error while loading shared libraries: libpython3.7m.so.1.0`

#992 llorenzo-matterport opened 2 years ago
0
The example in /examples/mxnet_vision/ does not work

#991 kylehh closed 2 years ago
1
Upgrade log4j to 2.17.1

#990 maaquib closed 2 years ago
0
Upgrade log4j version to 2.17.1

#989 glc-froussel closed 2 years ago
0
Remove ineffective log4j 1 references from code

#988 nikhil-sk opened 2 years ago
0
Default log level change from 1.1.4 -> 1.1.6

#987 kastman closed 2 years ago
4
Update gradle.properties

#986 maaquib closed 2 years ago
0
Update version.py

#985 maaquib closed 2 years ago
0
Adding disrupter dependency for async logging

#984 maaquib closed 2 years ago
0
Fixes log4j async logging issue

#983 frankfliu closed 2 years ago
0
Upgrade log4j to 2.16.0

#982 maaquib closed 2 years ago
0
Doc changes for log4j upgrade

#981 maaquib closed 2 years ago
0
Update QLogLayout for log4j2

#980 frankfliu closed 2 years ago
0
Upgrade log4j 1.2 to 2.15.0

#979 frankfliu closed 2 years ago
1