This sets up a local deployment for testing with a torchserve container and a sagemaker serverless deployment based for a custom torchserve container that works with sagemaker.
The serverless endpoint is currently running here. It can be accessed with
This sets up a local deployment for testing with a torchserve container and a sagemaker serverless deployment based for a custom torchserve container that works with sagemaker.
The serverless endpoint is currently running here. It can be accessed with
from the notebook /home/rave/animl/animl-ml/api/megadetectorv5/sagemaker-serverless-endpoint-with-torchserve/notebook/mdv5_deploy.ipynb
Files/Folders to pay attention to for review include notebooks/torchscript-yolov5.ipynb and
the yolov5 folder can be ignored, it was copied to provide easy access to the export.py submodule since the pypi package for it is old and unofficial.