Add Spark Support with AWS Glue Interactive Sessions

awslabs / aws-orbit-workbench

A Data Platform built for AWS, powered by Kubernetes.

https://awslabs.github.io/aws-orbit-workbench/

Apache License 2.0

127 stars 26 forks source link

Closed OElesin closed 1 year ago

dgraeber commented 2 years ago

@OElesin Thanks for reaching out. We will review whether to include the kernels in our images.

You can install the kernels into the Docker image (ref the Glue Developer Endpoint integration image) Please see https://docs.aws.amazon.com/glue/latest/dg/interactive-sessions.html

OElesin commented 2 years ago

Your recommendation: Glue Developer Endpoint or Glue Interactive Session for Spark Integration with Orbit Workbench?

dgraeber commented 2 years ago

The interactive session kernel is what I would suggest trying.