search

h2oai / sparkling-water

Sparkling Water provides H2O functionality inside Spark cluster
https://docs.h2o.ai/sparkling-water/3.3/latest-stable/doc/index.html
Apache License 2.0
954 stars 362 forks source link

[GH-5676][GH-5679][GH-5619] Add support for Python 3.10 & 3.11 #5677

Closed krasinski closed 8 months ago

krasinski commented 8 months ago

closes #5676 closes #5679 closes #5619

mn-mikke commented 8 months ago

@krasinski Can you also add support for python 3.11 in this PR? It will save you one image build. I think you will need to ignore tests for python 3.10.

tomasfryda commented 8 months ago

@mn-mikke python 3.12 is already out (https://docs.python.org/3/whatsnew/3.12.html). Would it make sense to include it here as well?

mn-mikke commented 8 months ago

@tomasfryda We would need to add the support for 3.12 in h2o first. Also there is no pyspark version that would support 3.12. This is the latest: https://pypi.org/project/pyspark/

mn-mikke commented 8 months ago

Only spark 3.4+ supports python 3.11: https://issues.apache.org/jira/browse/SPARK-41454 https://pypi.org/project/pyspark/3.3.3/ https://pypi.org/project/pyspark/3.4.0/