Open dgergel opened 3 years ago
@dgergel I started to try to fix this but realized the reason we took this out was that extra_pip_packages
is recommended over extra_conda_packages
when loading packages onto workers, b/c it can be much faster. Does extra_pip_packages
meet your needs? Or do you think we want to be able to conda install things. Also, if this is a generally useful package, we could add it to the main worker images (it's already on the coastal images).
@bolliger32 it would be great if we could add cfgrib
to the main worker images, that would solve an issue I'm working through right now - it's a requirement for using the grib backend for xarray
, which we need for pre-processing the ERA-5 grib files. My plan was to use it in a virtual env but it would be a lot easier to have it available in the default image. The reason for needing to conda install it is that the pip install isn't working at the moment, even if you pin earlier versions of eccodes
. Were there environment issues to work through when it was installed on the coastal images? I found conflicts when I tried to conda install it in the main worker images...
When passing the
extra_conda_packages
kwarg, e.g.client, cluster = rhgk.get_standard_cluster(extra_conda_packages='cfgrib')
, the following error occurs: