feat: update for bentoml 1.0 API

bentoml / aws-sagemaker-deploy

Fast model deployment on AWS Sagemaker

Apache License 2.0

15 stars 15 forks source link

feat: update for bentoml 1.0 API #26

Closed jjmachan closed 2 years ago

jjmachan commented 2 years ago

Adding support for the new bentoml 1.0 API. The new design also adds support for microbatching in sagemaker. ❤️ @bojiang for his inputs on the middleware.