RolnickLab / ClimateSetExtension

Data Processing Pipelines for ClimateSet - can be use to build your own climate model datasets for machine learning
0 stars 0 forks source link

Create compute canada env #6

Open liellnima opened 5 months ago

liellnima commented 5 months ago

See this previous issue here

Compute Canada / Alliance needs a different procedure to create the environment, since conda cannot be used directly, and we need to use module load for cdo and nco.

Requirements:

Additional information: We agreed on the following set to start the development of this package:

Python:

Additional dependencies:

Poetry dependencies:

f-PLT commented 4 months ago

@liellnima @mjfortier

I have a question on this.

From the documentation, I'm under the impression that on DRAC, they want us to install only from their own wheels (using virtualenv --no-downloads, and pip install --no-index)

Virtualenv is no issue, as we can create the virtualenv and use it with Poetry, and replicating --no-index can be worked around.

However, trying to install the dependencies, I found out that esgf-pyclient is not available in their local wheels (meaning we need to install it from the internet).

So, the actual question, how do you create your environments on DRAC usually? Do you use only the local wheel? Only from internet to get the latest versions? Dare I say a mix of both?