tnc-ca-geo / animl-ml

Machine Learning resources for camera trap data processing
Other
4 stars 1 forks source link

Test downloading the image from s3 from within pre-processing script #1

Closed nathanielrindlaub closed 4 years ago

nathanielrindlaub commented 4 years ago

There's a 5 MB limit to requests made to Sagemaker endpoints, so try passing in an S3 URI, intercepting that in the input_handler() in inference.py, and downloading the image there before submitting it to the model.

nathanielrindlaub commented 4 years ago

This is how it's currently working. Seems OK for now but definitely open to alternatives.

nathanielrindlaub commented 4 years ago

Example of someone else doing it: https://github.com/aws/sagemaker-tensorflow-serving-container/issues/73