search

SeldonIO / seldon-server

Machine Learning Platform and Recommendation Engine built on Kubernetes
https://www.seldon.io/
Apache License 2.0
1.47k stars 300 forks source link

Support for Apache Spark 2.X #35

Open thesuperzapper opened 7 years ago

thesuperzapper commented 7 years ago

Hey guys, I see that the current version of seldon-server uses Spark 1.5.2 by default, given the dramatic performance and feature improvements in Spark 2.X, are there any plans to support it?

ukclivecox commented 7 years ago

Yes. We would like to. Adding it instead of 1.5.2 in the kubernetes setup should be trivial change to the Pod JSONs to newer packages. We welcome your tests if you try this. Apart from that we would need to test the existing code/algos we have built into Seldon.