search

tensorflow / ecosystem

Integration of TensorFlow with other open-source frameworks
Apache License 2.0
1.37k stars 392 forks source link

Spark 3.0.0 with Scala 2.12 #169

Closed groodt closed 3 years ago

groodt commented 3 years ago

Spark 3.0.0 was officially released in June. The project is providing Scala 2.12 binaries.

I think the Tensorflow connector should now be targeting this newer version of Spark by default, and perhaps Spark 2.x in a branch. Spark 2.4.7 and other maintenance releases are likely in future, but I expect they will be bug fixes and backports or new features.

groodt commented 3 years ago

Please take a look @jhseu

groodt commented 3 years ago

Apologies @jhseu can you please let me know if this is likely to be reviewed or accepted as a contribution? Or assign a reviewer. :)

tekumara commented 3 years ago

Thanks so much for this! 👏

Is there a published version on maven central?

galv commented 3 years ago

Thanks so much for this! 👏

Is there a published version on maven central?

Seconded. It would make collaboration easier for me if I could point a prebuilt binary to others. (I don't see one here: https://mvnrepository.com/artifact/org.tensorflow/spark-tensorflow-connector)