conda-forge / pyspark-feedstock

A conda-smithy repository for pyspark.
BSD 3-Clause "New" or "Revised" License
4 stars 11 forks source link

Update to PySpark 3.5.3, limit numpy dependency to < 2 #51

Closed codesorcery closed 3 weeks ago

codesorcery commented 1 month ago

PySpark will only become compatible with NumPy 2 starting with PySpark 4. Thus, the NumPy dependency has been limited accordingly for PySpark 3.5 in https://github.com/apache/spark/pull/47175 The same should be done here, so that the builds will succeed again.

Checklist

conda-forge-admin commented 1 month ago

Hi! This is the friendly automated conda-forge-linting service.

I just wanted to let you know that I linted all conda-recipes in your PR (recipe/meta.yaml) and found it was in an excellent condition.

codesorcery commented 1 month ago

Build now fails, since only latest version (i.e. 3.5.3) is available at https://dist.apache.org/repos/dist/release/spark/ Thus, also directly updating PySpark to 3.5.3 here.

h-vetinari commented 3 weeks ago

Hey @codesorcery, thanks for the PR! It seems that @conda-forge/pyspark is not that active anymore, would you like to add yourself as a maintainer here?

codesorcery commented 3 weeks ago

Hi @h-vetinari, I'm not that deep into the build-setup for Conda packages and only use Conda for some side-projects. But if there's no one else maintaining this repository, I could try to do my best to maintain it.

h-vetinari commented 3 weeks ago

Cool! I'll join as well, so you can ask me if you have questions.

github-actions[bot] commented 3 weeks ago

Hi! This is the friendly conda-forge automerge bot!

I considered the following status checks when analyzing this PR:

Thus the PR was passing and merged! Have a great day!