search

awslabs / multi-model-server

Multi Model Server is a tool for serving neural net models for inference
Apache License 2.0
994 stars 231 forks source link

SAGEMAKER_MULTI_MODE in Ping should be SAGEMAKER_MULTI_MODEL #963

Open fm1ch4 opened 3 years ago

fm1ch4 commented 3 years ago

Per AWS documentation[1], the environment variable to decide if the container is running in Multi Model mode is SAGEMAKER_MULTI_MODEL, while in Ping.java the environment variable read is SAGEMAKER_MULTI_MODE[2]

[1] - https://docs.aws.amazon.com/sagemaker/latest/dg/build-multi-model-build-container.html

[2] - https://github.com/awslabs/multi-model-server/blob/1729efcf737c3c52324d4090da3b6542312e889d/plugins/endpoints/src/main/java/software/amazon/ai/mms/plugins/endpoint/Ping.java#L51