search

aws / sagemaker-spark

A Spark library for Amazon SageMaker.
https://aws.github.io/sagemaker-spark/
Apache License 2.0
299 stars 127 forks source link

Batch transform job using sagemaker_pyspark #107

Open KobaKhit opened 4 years ago

KobaKhit commented 4 years ago

Please fill out the form below.

System Information

Describe the problem

Are you guys planning on implementing the Transformer class in sagemaker_pyspark? I know I am able to use SageMakerModel class to create an endpoint and transform a spark dataframe. It would also be useful to be able to transform a spark dataframe using a batch transform job without me having to worry about deleting the endpoint. Thank you.

Minimal repo / logs

laurenyu commented 4 years ago

hi there, thanks for your interest. unfortunately, we're not sure at the moment if this is something that we'll add anytime soon, but we're always reprioritizing our backlog based on customer feedback.