feature: adding support for AsyncInferenceConfig in endpoint config

aws / aws-step-functions-data-science-sdk-python

Step Functions Data Science SDK for building machine learning (ML) workflows and pipelines on AWS

Apache License 2.0

285 stars 87 forks source link

feature: adding support for AsyncInferenceConfig in endpoint config #170

Open Luca-Ferrera opened 2 years ago

Luca-Ferrera commented 2 years ago

The EndpointConfig constructor could be extended to support passing in AsyncInferenceConfig which includes configuration as shown here in the doc API_AsyncInferenceConfig In this way would be possible to create an EndpountConfig supporting Asynchronous Inference.

ca-nguyen commented 2 years ago

Hi @Luca-Ferrera, I can see this being used by many of our customers - this will be a great feature to add to the Data Science SDK. Thank you for bringing this to our attention.