Add support for Python=3.12

valeriupredoi commented 8 months ago

Once https://github.com/ESMValGroup/ESMValCore/pull/2228 *allowing support for Python=3.12 in ESMValCore), we should see what roadblocks we have here, so am starting early. That Core PR is currently roadblocked only by prospector not being Python=3.12-compatible, but we're working on that.

Current issues

esmpy/esmf >=8.6.0 conflicting in deps with ncl - see https://github.com/conda-forge/ncl-feedstock/pull/155 that doesn't work until NCL fix the issue with esmf upstream (I'd do it myself, but I got absolutely no clues how to, did open an issue tho https://github.com/NCAR/ncl/issues/213) ~everyone via gdal/libgdal -> very brittle env that can only be solved only for old gdal 3.7.2 (that is, in turn, rejected by such likes as fiona); gotta wait until the ecosystem settles~
~prospector issue~ not if we drop prospector as we did in ESMValCore
~psy-reg needs attention see https://github.com/conda-forge/psy-reg-feedstock/pull/18~

Previous issues

~esmvalcore (prospector is the only roadblock there)~
~ncl -> issue with builds against later proj's (>=9.3.1) https://github.com/NCAR/ncl/issues/210~
~r-akima needs unpinned~ https://github.com/ESMValGroup/ESMValTool/pull/3564
~psy- suite (also at install point they need to move from SafeConfigParser to regular parser, via AttributeError: module 'configparser' has no attribute 'SafeConfigParser' - SafeConfigParser has now been fully retired in 3.12)~ psy-stuff has now been updated to support 3.12 via @Chilipp good work, see https://github.com/conda-forge/psyplot-feedstock/pull/27 - except psy-reg which still needs a rebuild (with Philipp's new infrastructure)
prospector (direct dep here, and as we have it via esmvalcore) - needs https://github.com/landscapeio/prospector/pull/645 that, in turn, needs a fix/workaround of master proposed in https://github.com/landscapeio/prospector/pull/658
all else is fine!

Also closes https://github.com/ESMValGroup/ESMValTool/issues/3642

valeriupredoi commented 6 months ago

@ESMValGroup/technical-lead-development-team we are inching closer to suppoert Python=3.12 - have a look here https://github.com/ESMValGroup/ESMValTool/actions/runs/8453069262/job/23154935341?pr=3501 - only 4 dependencies need to be rebuilt fro 3.12 - I am a bit at a deadend with prospector though, been waiting on my PR to be merged there since last November; the psy- pkgs I believe that will be updated soon, will go pinch Philipp there; the :elephant: in the room is NCL - am gonna go see what's the atmosphere there; and the pesky one is r-akima - we need to unpin it! :beer:

valeriupredoi commented 6 months ago

OK the issue with NCL is not as bad as I thought - it's compatibility with later proj's see https://github.com/NCAR/ncl/issues/210

valeriupredoi commented 6 months ago

~note to self: rerun tests sooner than later, psy-maps only made it to conda-forge just about an hour ago~

done :partying_face:

valeriupredoi commented 4 months ago

NCL works now :partying_face:

valeriupredoi commented 4 months ago

the only way we got the env to solve with 3.12 and NCL is here

esmf                      8.4.2           nompi_h9e768e6_3    conda-forge
esmpy                     8.4.2              pyhc1e730c_4    conda-forge
gdal                      3.8.5           py312h86af8fa_7    conda-forge
libgdal                   3.8.5                h77540a9_7    conda-forge
geos                      3.12.1               h59595ed_0    conda-forge
ncl                       6.6.2               h41fde0b_52    conda-forge
proj                      9.4.0                h1d62c97_1    conda-forge
pyproj                    3.6.1           py312hb591178_6    conda-forge
shapely                   2.0.4           py312ha5b4d35_1    conda-forge

valeriupredoi commented 3 months ago

Finally! After massaging Mamba all ways, we found the core of the deps issue:

  LibMambaUnsatisfiableError: Encountered problems while solving:
    - package ncl-6.6.2-h3c68598_53 requires esmf <8.6.0, but none of the providers can be installed

that NCL build is the second to latest, and the first that supports python 3.12 via supporting proj>=9.4 -> will have a look at why NCL is restricting esmf, hopefully it's just a case of they've not updated their pins just yet

valeriupredoi commented 3 months ago

Finally! After massaging Mamba all ways, we found the core of the deps issue:
  LibMambaUnsatisfiableError: Encountered problems while solving:
    - package ncl-6.6.2-h3c68598_53 requires esmf <8.6.0, but none of the providers can be installed
that NCL build is the second to latest, and the first that supports python 3.12 via supporting proj>=9.4 -> will have a look at why NCL is restricting esmf, hopefully it's just a case of they've not updated their pins just yet

Fix in https://github.com/conda-forge/ncl-feedstock/pull/155