Toolkit for allowing inference and serving with PyTorch on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at https://github.com/aws/deep-learning-containers.
Apache License 2.0
131
stars
70
forks
source link
Reuse the requirements.txt installation logic from sagemaker-inference-toolkit #149
Describe the feature you'd like
sagemaker-inference-toolkit
is in the middle of introducing support for installingrequirements.txt
dependencies from CodeArtifact in https://github.com/aws/sagemaker-inference-toolkit/pull/130Additional context
https://github.com/aws/sagemaker-pytorch-inference-toolkit/blob/master/src/sagemaker_pytorch_serving_container/torchserve.py#L81 is identical to https://github.com/aws/sagemaker-inference-toolkit/blob/master/src/sagemaker_inference/model_server.py#L82
Reusing the logic from
sagemaker-inference-toolkit
would allow sagemaker pytorch containers to get the support for CodeArtifact