aws / amazon-sagemaker-examples

Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.
https://sagemaker-examples.readthedocs.io
Apache License 2.0
10.03k stars 6.75k forks source link

[Feature Request] Serverless Inference with VPC Config #3102

Open RichardSieg opened 2 years ago

RichardSieg commented 2 years ago

I would like to use a Sagemaker Model with a custom VPC Configuration, which is currently not possible with Serverless Inference. Is this feature planned? More generally: Is there a roadmap somewhere for Serverless Inference and/or a better place to post feature requests?

deniskovalenko commented 2 years ago

+1 here, that would make serverless much more appealing for my company's use-case

falkvonohlen commented 2 years ago

+1

abhayaps commented 1 year ago

+1

j-adamczyk commented 1 year ago

+1

skannan-maf commented 1 year ago

+100

EgorOs commented 1 year ago

+1

manuelfedele commented 9 months ago

I agree. Pricing is challenging without this feature.

RichardSieg commented 7 months ago

We just got an update from AWS that the feature is on the roadmap.

Good news – we have an update on the product feature request for ” Add VPC support for SageMaker Serverless Inference similar to support that exists for Lambda”, which you’ve been a part of in previous conversations. This has been reviewed my the product teams and is now on the roadmap.