Closed valeriupredoi closed 2 weeks ago
Hmm there seems to be quite a lot going on here. I am not sure we can do much in this repository. So this is using an old release of NetCDF.jl from 2020, that triggers a segfault when starting it in a Conda environment.
The netCDF build that comes with NetCDF.jl has improved a lot since 2020. I guess that old build may be clashing with the libcurl that is used by Conda? As you can see in issues like https://github.com/JuliaPy/PythonCall.jl/issues/519 there can be clashes like this sometimes, and one solution is to pin Conda dependencies to versions that go well with the Julia environment. Though I'd try to use a more recent NetCDF.jl version if possible.
Newer netCDF builds will also be compatible with newer curl versions, by updates in Yggdrasil, like https://github.com/JuliaPackaging/Yggdrasil/pull/7127.
Hi @visr and very many thanks for taking the time to reply! We have tested with a new NetCDF=0.12.0 and new Julia=1.10.4, but we are still hitting the curl
-related SegFault but admittedly not from installing NetCDF AFAIK, please see our Github Action test - me not knowing much about Julia doesn't come in handy here, unfortunately - what do you recommend for a working environment in terms of packages and versions, in your opinion, please? Sorry for hassling you - I finally found someone who knows Julia and can help, would buy pints for that :beer: :grin:
here's how our Project.toml
looks like (RainFARM commented out since I know for certain that pulls in the old NetCDF):
ArgParse = "c7e460c6-2fb9-53a9-8c5b-16f535851c63"
Compat = "34da2185-b29b-5c13-b0c7-acf172513d20"
DataFrames = "a93c6f00-e57d-5684-b7b6-d8193f3e46c0"
JSON = "682c06a0-de6a-54ab-a142-c8b1cf79cde6"
NetCDF = "30363a11-5582-574a-97bb-aa9a979735b9"
PyCall = "438e738f-606a-5dbb-bf0a-cddfbfd45ab0"
PyPlot = "d330b81b-6aea-500a-939a-2ce795aea3ee"
# RainFARM = "e9a4e08f-a0a3-5224-a821-6d0231c12d6b"
Statistics = "10745b16-79ce-11e8-11f9-7d13ad32a3b2"
YAML = "ddb6d928-2868-570f-bddf-ab3f9cf99eb6"
Many thanks again!
UPDATE: @visr it seems that all our and others' troubles stem from one single place (not NetCDF.jll not other bits) - the new curl
8.10+ - pinning it to lower than that allows for all Julia gubbins be installed even with the old Julia 1.9.3 - see our PR https://github.com/ESMValGroup/ESMValTool/pull/3755 and Github Action - my apologies for bugging you here (and, invariably, for pointing a finger at NetCDF :grin: ). Many thanks for all your help! :beer:
Thanks for letting us know, glad you can work around it. So it seems a change in curl 8.10 triggered a segfault through https://github.com/JuliaLang/Downloads.jl/issues/260.
yep - and not being fluent in Julia, it wasn't obvious to me :grin:
Hi folks, we've started seeing perfectly reproducible SegFaults when trying to install
NetCDF=0.10.3
, either using aProject.toml
or simply by installing it in from command line:that returns:
Please see GA test for full install stdout
In fairness, I am not 100% sure this is indeed from NetCDF, and could be this issue https://github.com/JuliaLang/Downloads.jl/issues/260 - but thought of reporting it nonetheless, apologies if this is something else!
Please let me know if you need more details about the particularities of our system! Cheers very much for looking into it :beer: