New Jupyter env build with new xlrd, pre-commit, pin dask, distributed, cf_xarray, latest of everything else

[tlvu]

Relevant Changes

>   - pre-commit=2.17.0=py38h578d9bd_0
>   - xlrd=2.0.1=pyhd8ed1ab_3

<   - xclim=0.32.1=pyhd8ed1ab_0
>   - xclim=0.34.0=pyhd8ed1ab_0

<   - cfgrib=0.9.9.1=pyhd8ed1ab_1
>   - cfgrib=0.9.10.1=pyhd8ed1ab_0

<   - cftime=1.5.1.1=py38h6c62de6_1
>   - cftime=1.6.0=py38h3ec907f_0

<   - intake-xarray=0.5.0=pyhd8ed1ab_0
>   - intake-xarray=0.6.0=pyhd8ed1ab_0

<   - pandas=1.3.5=py38h43a58ef_0
>   - pandas=1.4.1=py38h43a58ef_0

<   - regionmask=0.8.0=pyhd8ed1ab_1
>   - regionmask=0.9.0=pyhd8ed1ab_0

<   - rioxarray=0.9.1=pyhd8ed1ab_0
>   - rioxarray=0.10.3=pyhd8ed1ab_0

<   - xarray=0.20.2=pyhd8ed1ab_0
>   - xarray=2022.3.0=pyhd8ed1ab_0

<   - zarr=2.10.3=pyhd8ed1ab_0
>   - zarr=2.11.1=pyhd8ed1ab_0

New Packages Pins

dask and distributed was causing PAVICStutorial_ClimateDataAnalysis-3Climate-Indicators.ipynb to run excessively slow.

cf_xarray caused climex.ipynb to be slow.

See https://github.com/Ouranosinc/PAVICS-e2e-workflow-tests/issues/100 for more info why these had to be pinned.

Related Issue / Discussion

• Fixes https://github.com/Ouranosinc/PAVICS-e2e-workflow-tests/issues/97
• https://github.com/Ouranosinc/PAVICS-e2e-workflow-tests/issues/99
• https://github.com/Ouranosinc/PAVICS-e2e-workflow-tests/issues/100
• PR to deploy this new Jupyter env to PAVICS: https://github.com/bird-house/birdhouse-deploy/pull/240

Test Results

• Deployed as "beta" image in production for bokeh visualization performance regression testing.

• Manual test notebook https://github.com/Ouranosinc/PAVICS-landing/blob/master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-5Visualization.ipynb for bokeh visualization performance and it looks fine.

• Jenkins build, only known intermittent error: subset-user-input.ipynb: RemoteDisconnected, slow WPS_example.ipynb: http://jenkins.ouranos.ca/job/PAVICS-e2e-workflow-tests/job/preview-docker-build/37/console, logs: job-PAVICS-e2e-workflow-tests-preview-docker-build-37-consoleText.txt

• Jenkins build 2, only known intermittent error: subset-user-input.ipynb: RemoteDisconnected, opendap.ipynb runtime crashed: http://jenkins.ouranos.ca/job/PAVICS-e2e-workflow-tests/job/new-docker-build/7/console, logs: job-PAVICS-e2e-workflow-tests-new-docker-build-7-consoleText.txt

• Jenkins build 3, only known intermittent error: stress-test.ipynb "ValueError: max() arg is an empty sequence": http://jenkins.ouranos.ca/job/PAVICS-e2e-workflow-tests/job/new-docker-build/8/console, logs: job-PAVICS-e2e-workflow-tests-new-docker-build-8-consoleText.txt

• Jenkins build 4, only known intermittent error: WMS_example.ipynb: SyntaxError: not a PNG file, stress-tests.ipynb: ValueError: max() arg is an empty sequence, , slow WPS_example.ipynb: http://jenkins.ouranos.ca/job/PAVICS-e2e-workflow-tests/job/new-docker-build/12/console, logs: job-PAVICS-e2e-workflow-tests-new-docker-build-12-consoleText.txt

Additional Information

• Full conda env export diff: 220121-220401-conda-env-export.diff.txt

• Full new conda env export: 220401-conda-env-export.yml.txt

[tlvu]

@tlogan2000 this is deployed as "beta" image in production, could you do a quick bokeh visualization performance test to spot for regressions that we've seen in the past?