The torchserve support is primarlty consumed by sagemaker-pytorch-inference-toolkit. Integration tests were performed against the consuming package to ensure that existing contract works. More details in https://github.com/aws/sagemaker-pytorch-inference-toolkit/pull/79
Torchserve support for PyTorch Inference
This is part of 3 PRs in sagemaker-inference-toolkit / sagemaker-pytorch-inference-toolkit / dlc to add support for TorchServe in Sagmaker.
Other 2 PRs which depend on this : https://github.com/aws/sagemaker-pytorch-inference-toolkit/pull/79 / https://github.com/aws/deep-learning-containers/pull/347
Testing done
General
Tests
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.