Support for Spark 3.2.0+ with scala 2.13

linkedin / spark-tfrecord

Read and write Tensorflow TFRecord data from Apache Spark.

BSD 2-Clause "Simplified" License

290 stars 57 forks source link

Support for Spark 3.2.0+ with scala 2.13 #49

Open sheilahu opened 2 years ago

sheilahu commented 2 years ago

Hi,

I am wondering if there is plan to support spark with scala 2.13 and what the timeline looks like.

Thank you.

junshi15 commented 2 years ago

This is a PR for Spark 3.2 + 2.12. I plan to merge it this weekend. Scala 2.13 is tricky, I will see how easy it is. We don't have a timeline for it. This project is user-driven: we are not actively developing it any more, but we rely on community's contribution for new features.

junshi15 commented 2 years ago

v0.5.0 (Spark 3.2 + Scala 2.13) has been published. https://search.maven.org/artifact/com.linkedin.sparktfrecord/spark-tfrecord_2.13/0.5.0/jar Please let me know if it works for you.