search

dotnet / spark

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.
https://dot.net/spark
MIT License
2.03k stars 315 forks source link

[FEATURE REQUEST]: Add support/docs for K8s spark operator #219

Open AceHack opened 5 years ago

AceHack commented 5 years ago

Please add support/docs for K8s spark operator https://github.com/GoogleCloudPlatform/spark-on-k8s-operator

https://github.com/GoogleCloudPlatform/spark-on-k8s-operator/issues/584

AceHack commented 5 years ago

I've created a repo that creates a docker image that has the two projects working together.

https://github.com/AceHack/spark-on-k8s-dotnet

I will update the readme soon on the steps to follow.

AceHack commented 5 years ago

Since I have this working in my repo above I would happily take on the work on making it supported first class in this repo if that is a PR you are interested in.

If so it would help if we could have some discussions/zoom meeting about how it could be integrated as there are some questions about the best way to integrate.

Also, I would love to try and get both you and the Google guys supporting GoogleCloudPlatform/spark-on-k8s-operator on the horn at the same time so we are all on the same page.

Is this something you would be interested in pursuing?

Thanks.