bird-house / birdhouse-deploy

Scripts and configurations to deploy the various birds and servers required for a full-fledged production platform
https://birdhouse-deploy.readthedocs.io/en/latest/
Apache License 2.0
4 stars 7 forks source link

limit Magpie usernames #396

Closed mishaschwartz closed 12 months ago

mishaschwartz commented 1 year ago

Overview

When Jupyterhub spawns a new jupyterlab container, it escapes any non-ascii, non-digit character in the username. This results in a username that may not match the expected username (as defined by Magpie). This mismatch results in the container failing to spawn since expected volumes cannot be mounter to the jupyterlab container.

This fixes the issue by ensuring that juptyerhub does not convert the username that is receives from Magpie.

Changes

Non-breaking changes

Breaking changes

Related Issue / Discussion

Additional Information

birdhouse_daccs_configs_branch: master birdhouse_skip_ci: false

crim-jenkins-bot commented 1 year ago

E2E Test Results

DACCS-iac Pipeline Results

Build URL : http://daccs-jenkins.crim.ca:80/job/DACCS-iac-birdhouse/2181/
Result : failure

BIRDHOUSE_DEPLOY_BRANCH : limit-magpie-usernames
DACCS_CONFIGS_BRANCH : master
PAVICS_E2E_WORKFLOW_TESTS_BRANCH : master
PAVICS_SDI_BRANCH : master

DESTROY_INFRA_ON_EXIT : true
PAVICS_HOST : https://host-140-20.rdext.crim.ca

PAVICS-e2e-workflow-tests Pipeline Results

Tests URL : http://daccs-jenkins.crim.ca:80/job/PAVICS-e2e-workflow-tests/job/master/1383/

NOTEBOOK TEST RESULTS
    
[2023-10-25T15:07:53.184Z] ============================= test session starts ==============================
[2023-10-25T15:07:53.184Z] platform linux -- Python 3.9.16, pytest-7.3.1, pluggy-1.0.0
[2023-10-25T15:07:53.184Z] rootdir: /home/jenkins/agent/workspace/PAVICS-e2e-workflow-tests_master
[2023-10-25T15:07:53.184Z] plugins: anyio-3.6.1, dash-2.10.0, nbval-0.9.6, tornasync-0.6.0.post2, xdist-3.3.1
[2023-10-25T15:07:53.184Z] collected 254 items
[2023-10-25T15:07:53.184Z] 
[2023-10-25T15:07:58.457Z] notebooks-auth/geoserver.ipynb .........FF..FFF.                         [  6%]
[2023-10-25T15:08:03.232Z] notebooks-auth/test_thredds.ipynb ...F..FFFF.                            [ 11%]
[2023-10-25T15:08:11.435Z] pavics-sdi-master/docs/source/notebooks/WCS_example.ipynb .......        [ 13%]
[2023-10-25T15:08:21.525Z] pavics-sdi-master/docs/source/notebooks/WFS_example.ipynb ......         [ 16%]
[2023-10-25T15:08:27.743Z] pavics-sdi-master/docs/source/notebooks/WMS_example.ipynb .F......       [ 19%]
[2023-10-25T15:15:55.470Z] pavics-sdi-master/docs/source/notebooks/climex.ipynb ............        [ 24%]
[2023-10-25T15:15:55.470Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-climate-stations.ipynb . [ 24%]
[2023-10-25T15:16:03.269Z] ...............                                                          [ 30%]
[2023-10-25T15:16:12.647Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-xclim.ipynb F.F..    [ 32%]
[2023-10-25T15:16:19.509Z] pavics-sdi-master/docs/source/notebooks/esgf-dap.ipynb ......            [ 34%]
[2023-10-25T15:16:34.875Z] pavics-sdi-master/docs/source/notebooks/forecasts.ipynb ......           [ 37%]
[2023-10-25T15:16:36.276Z] pavics-sdi-master/docs/source/notebooks/jupyter_extensions.ipynb .       [ 37%]
[2023-10-25T15:16:43.951Z] pavics-sdi-master/docs/source/notebooks/opendap.ipynb .......            [ 40%]
[2023-10-25T15:16:48.449Z] pavics-sdi-master/docs/source/notebooks/pavics_thredds.ipynb .....       [ 42%]
[2023-10-25T15:20:58.645Z] pavics-sdi-master/docs/source/notebooks/regridding.ipynb ............... [ 48%]
[2023-10-25T15:22:10.724Z] .............                                                            [ 53%]
[2023-10-25T15:22:14.913Z] pavics-sdi-master/docs/source/notebooks/rendering.ipynb ....             [ 54%]
[2023-10-25T15:22:17.635Z] pavics-sdi-master/docs/source/notebooks/subset-user-input.ipynb ........ [ 57%]
[2023-10-25T15:22:33.331Z] .................                                                        [ 64%]
[2023-10-25T15:22:41.665Z] pavics-sdi-master/docs/source/notebooks/subsetting.ipynb ......          [ 66%]
[2023-10-25T15:22:43.057Z] pavics-sdi-master/docs/source/notebook-components/weaver_example.ipynb . [ 67%]
[2023-10-25T15:22:44.413Z] .FFFFFFFF                                                                [ 70%]
[2023-10-25T15:22:55.252Z] finch-master/docs/source/notebooks/dap_subset.ipynb ...........          [ 75%]
[2023-10-25T15:23:05.305Z] finch-master/docs/source/notebooks/finch-usage.ipynb ......              [ 77%]
[2023-10-25T15:23:06.691Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-1DataAccess.ipynb . [ 77%]
[2023-10-25T15:23:09.782Z] ......                                                                   [ 80%]
[2023-10-25T15:23:17.934Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-2Subsetting.ipynb . [ 80%]
[2023-10-25T15:23:33.268Z] .............                                                            [ 85%]
[2023-10-25T15:23:43.258Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-3Climate-Indicators.ipynb . [ 86%]
[2023-10-25T15:24:24.077Z] ....s.                                                                   [ 88%]
[2023-10-25T15:24:32.227Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-4Ensembles.ipynb . [ 88%]
[2023-10-25T15:24:45.483Z] ...                                                                      [ 90%]
[2023-10-25T15:25:00.389Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-5Visualization.ipynb . [ 90%]
[2023-10-25T15:25:23.738Z] ......                                                                   [ 92%]
[2023-10-25T15:25:26.029Z] notebooks/hummingbird.ipynb ............                                 [ 97%]
[2023-10-25T15:28:00.173Z] notebooks/stress-tests.ipynb ......                                      [100%]
[2023-10-25T15:28:00.173Z] 
[2023-10-25T15:28:00.173Z] =================================== FAILURES ===================================
    
  
fmigneault commented 1 year ago

And if {raw_username} doesn't work, we can also provide our own escape function: https://github.com/jupyterhub/dockerspawner/blob/a6bf72e764dfcfdf4d1dbb1c5a84bedd183505e2/dockerspawner/dockerspawner.py#L600-L618

Or even override escaped_name property specifically: https://github.com/jupyterhub/dockerspawner/blob/a6bf72e764dfcfdf4d1dbb1c5a84bedd183505e2/dockerspawner/dockerspawner.py#L870-L875 since we define a custom dockerspawner anyway https://github.com/bird-house/birdhouse-deploy/blob/4e890d6e40aab199d78cf07f62f1b5e07682455f/birdhouse/config/jupyterhub/jupyterhub_config.py.template#L25

mishaschwartz commented 1 year ago

@fmigneault

As @tlvu mentions here (https://github.com/bird-house/birdhouse-deploy/issues/393#issuecomment-1769089001) having a different username in Magpie as in Jupyterhub adds an additional burden on admins who are trying to manage the system.

Also, having mismatched names may cause confusion for users who log in with one username and see a different username displayed in jupyterlab.

Finally, any strategy that requires us to escape usernames means we have to be very very careful about conflicts.

For example, in Magpie, we can theoretically have two users: example.user and example-2euser. If the escape function converts . to -2e (as it does now) then these two users will be able to access each other's jupyterlab container.

I'm not saying we can't construct an escape function that will be foolproof, I just think that this adds a ton of extra complexity that we have to worry about.

In my opinion it is simpler for both admins, developers, and users to simply restrict the usernames in Magpie

fmigneault commented 1 year ago

@mishaschwartz But the links I referenced here are exactly to avoid escaping, in order to remove the problematic feature Jupyter applies by default causing modified user names. Therefore, user names from Magpie would be used as is. Users would not see an escaped variations of their name in Jupyter, it would be the same one they used for signin up in Magpie.

mishaschwartz commented 1 year ago

@fmigneault

You're right, my comments were only responding to your suggestion to override escape_name. However:

I really think that the best and simplest option is to just restrict user names

fmigneault commented 1 year ago

@mishaschwartz An override could simply be:

class CustomDockerSpawner(DockerSpawner): 
    @property
    def escaped_name(self):
        return self.user.name

Since the authenticator is also a custom implementation, it is a very quick to override normalize_username the same way.

Magpie allows spaces in usernames

Good point. I'm not against limiting spaces in the configured regex to avoid issues with docker and paths that would not be properly quoted. However, this is still lower impact than blocking _/-/uppercase which are more common in usernames.

tlvu commented 1 year ago

Just to recap, we are still discussing about this PR simply to have _/-/uppercase in the username?

I don't think it is worth it. No users have ever complained to us in production that they did not like the username we gave them and need to have _/-/uppercase in the username.

I would rather have the regular {username} over {raw_username} with the extra username validation regex. It just feels simpler and more safe. If JupyterHub take the effort to have a "safe" {username}, I think probably there is a reason.

fmigneault commented 1 year ago

We do have some users that have ., _, -. Even some control users in birdhouse used these characeters, eg; admin-catalog. These users are not actively using Jupyter, hence why nothing "broke" for them, but restricting their usernames because of Jupyter seems like patching the issue the wrong way around.

Recaping everything, I would suggest that {username} are always used (as already done), but override the 2 functionsthat do the escape (for volume and docker names respectively) to simply not do them. There is no need for extra validation regex, since that is already enforced by Magpie user registration. In Magpie, @mishaschwartz's feature would be used to set ^[A-Za-z0-9]+(?:[_\-\.][A-Za-z0-9]+)*$ such that only the spaces are removed from Magpie's default regex.

mishaschwartz commented 1 year ago

We do have some users that have ., _, -. Even some control users in birdhouse used these characeters, eg; admin-catalog.

@fmigneault This would have been useful to know earlier in the discussion so that I could have understood why you were objecting so strongly to this change.

With regards to the admin-catalog user: this user is only added if the (deprecrated) catalog component is enabled and it is added to jupyterhub's blacklist anyway. I'm not inclined to limit this change in order to support a deprecated component.

Are there other control users that you are concerned about that are not deprecated?

If JupyterHub take the effort to have a "safe" {username}, I think probably there is a reason.

This is giving me pause too @tlvu . I don't want to override these functions and then create other conflicts later on. However, the fact that jupyter provides public configuration options to override these settings makes me feel a little bit better about it. I would be willing to consider overriding these functions after thorough testing.

In summary:

tlvu commented 1 year ago
  • If there are non-deprecated control users that contain special character that we need to support,

The admin-catalog user will never login to Jupyter. If any other non-deprecated control users that ever need to login to Jupyter, we can also just rename them since they are totally under our control. So far, I think, probably, none of the control users need to login to Jupyter yet. Otherwise, we would already see problems in production.

This is just to say, unless the effort to test the override functions is simple and quick, then yes go for it since it's nice to have - and _ in username. Otherwise I don't think it's worth the time.

Note that we can always defer overriding the functions later since it's easy to relax existing restriction. It's much harder to tighten restrictions since it implies manually fixing all the relaxed usernames that become illegal with harder restriction.

mishaschwartz commented 1 year ago

I can try and test this a little later. I'm just working on other stuff right now so it might be a few days until I can get to this.

crim-jenkins-bot commented 1 year ago

E2E Test Results

DACCS-iac Pipeline Results

Build URL : http://daccs-jenkins.crim.ca:80/job/DACCS-iac-birdhouse/2217/
Result : failure

BIRDHOUSE_DEPLOY_BRANCH : limit-magpie-usernames
DACCS_CONFIGS_BRANCH : master
PAVICS_E2E_WORKFLOW_TESTS_BRANCH : master
PAVICS_SDI_BRANCH : master

DESTROY_INFRA_ON_EXIT : true
PAVICS_HOST : https://host-140-133.rdext.crim.ca

PAVICS-e2e-workflow-tests Pipeline Results

Tests URL : http://daccs-jenkins.crim.ca:80/job/PAVICS-e2e-workflow-tests/job/master/1400/

NOTEBOOK TEST RESULTS
    
[2023-11-08T15:47:45.115Z] ============================= test session starts ==============================
[2023-11-08T15:47:45.115Z] platform linux -- Python 3.9.16, pytest-7.3.1, pluggy-1.0.0
[2023-11-08T15:47:45.115Z] rootdir: /home/jenkins/agent/workspace/PAVICS-e2e-workflow-tests_master@2
[2023-11-08T15:47:45.115Z] plugins: anyio-3.6.1, dash-2.10.0, nbval-0.9.6, tornasync-0.6.0.post2, xdist-3.3.1
[2023-11-08T15:47:45.115Z] collected 255 items
[2023-11-08T15:47:45.115Z] 
[2023-11-08T15:47:52.452Z] notebooks-auth/geoserver.ipynb .........F...FFFF.                        [  7%]
[2023-11-08T15:47:56.853Z] notebooks-auth/test_thredds.ipynb ...F..FFFF.                            [ 11%]
[2023-11-08T15:48:05.530Z] pavics-sdi-master/docs/source/notebooks/WCS_example.ipynb .......        [ 14%]
[2023-11-08T15:48:17.913Z] pavics-sdi-master/docs/source/notebooks/WFS_example.ipynb ......         [ 16%]
[2023-11-08T15:48:24.511Z] pavics-sdi-master/docs/source/notebooks/WMS_example.ipynb ........       [ 19%]
[2023-11-08T15:57:18.690Z] pavics-sdi-master/docs/source/notebooks/climex.ipynb ............        [ 24%]
[2023-11-08T15:57:18.690Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-climate-stations.ipynb . [ 24%]
[2023-11-08T15:57:33.235Z] ...............                                                          [ 30%]
[2023-11-08T15:57:44.299Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-xclim.ipynb .....    [ 32%]
[2023-11-08T15:58:43.447Z] pavics-sdi-master/docs/source/notebooks/esgf-dap.ipynb ......            [ 34%]
[2023-11-08T15:58:55.398Z] pavics-sdi-master/docs/source/notebooks/forecasts.ipynb ......           [ 37%]
[2023-11-08T15:58:57.039Z] pavics-sdi-master/docs/source/notebooks/jupyter_extensions.ipynb .       [ 37%]
[2023-11-08T15:59:03.553Z] pavics-sdi-master/docs/source/notebooks/opendap.ipynb .......            [ 40%]
[2023-11-08T15:59:08.060Z] pavics-sdi-master/docs/source/notebooks/pavics_thredds.ipynb .....       [ 42%]
[2023-11-08T16:03:33.648Z] pavics-sdi-master/docs/source/notebooks/regridding.ipynb ............... [ 48%]
[2023-11-08T16:04:45.388Z] .............                                                            [ 53%]
[2023-11-08T16:04:50.101Z] pavics-sdi-master/docs/source/notebooks/rendering.ipynb ....             [ 54%]
[2023-11-08T16:04:52.315Z] pavics-sdi-master/docs/source/notebooks/subset-user-input.ipynb ........ [ 58%]
[2023-11-08T16:05:09.289Z] .................                                                        [ 64%]
[2023-11-08T16:05:16.275Z] pavics-sdi-master/docs/source/notebooks/subsetting.ipynb ......          [ 67%]
[2023-11-08T16:05:18.191Z] pavics-sdi-master/docs/source/notebook-components/weaver_example.ipynb . [ 67%]
[2023-11-08T16:05:41.088Z] ........F                                                                [ 70%]
[2023-11-08T16:05:50.180Z] finch-master/docs/source/notebooks/dap_subset.ipynb ...........          [ 75%]
[2023-11-08T16:05:58.899Z] finch-master/docs/source/notebooks/finch-usage.ipynb ......              [ 77%]
[2023-11-08T16:06:00.286Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-1DataAccess.ipynb . [ 78%]
[2023-11-08T16:06:03.367Z] ......                                                                   [ 80%]
[2023-11-08T16:06:09.947Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-2Subsetting.ipynb . [ 80%]
[2023-11-08T16:06:25.317Z] .............                                                            [ 85%]
[2023-11-08T16:06:35.325Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-3Climate-Indicators.ipynb . [ 86%]
[2023-11-08T16:07:11.901Z] ....s.                                                                   [ 88%]
[2023-11-08T16:07:18.483Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-4Ensembles.ipynb . [ 89%]
[2023-11-08T16:07:33.992Z] ...                                                                      [ 90%]
[2023-11-08T16:07:46.221Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-5Visualization.ipynb . [ 90%]
[2023-11-08T16:08:10.102Z] ......                                                                   [ 92%]
[2023-11-08T16:08:12.582Z] notebooks/hummingbird.ipynb ............                                 [ 97%]
[2023-11-08T16:10:46.704Z] notebooks/stress-tests.ipynb ......                                      [100%]
[2023-11-08T16:10:46.704Z] 
[2023-11-08T16:10:46.704Z] =================================== FAILURES ===================================
    
  
mishaschwartz commented 1 year ago

@fmigneault @tlvu

Testing the user name

Set up

Test 1: create a user with a space in their name

Test 2: create a user with capital letter in their name
Test 3: create a user with capital letter in their name, sign in as lowercase username equivalent
Test 4: create a user with capital letter in their name, and another with the lowercase username equivalent, sign in as capitalized user
Test 5: create a user with capital letter in their name, and another with the lowercase username equivalent, sign in as lowercase user
Test 6: create a user with a special character in their name

Summary:

I don't see any issues with jupyterhub if all we do is keep jupyter from converting the username and ensuring that magpie does not allow whitespace in usernames

BUT... there is an issue in Magpie where username capitalization in ignored when logging in. We need to make sure that Magpie doesn't confuse users whose usernames only differ in terms of capitalization. Probably what is happening is that the username look up is not case sensitive.

TODO:

crim-jenkins-bot commented 1 year ago

E2E Test Results

DACCS-iac Pipeline Results

Build URL : http://daccs-jenkins.crim.ca:80/job/DACCS-iac-birdhouse/2218/
Result : failure

BIRDHOUSE_DEPLOY_BRANCH : limit-magpie-usernames
DACCS_CONFIGS_BRANCH : master
PAVICS_E2E_WORKFLOW_TESTS_BRANCH : master
PAVICS_SDI_BRANCH : master

DESTROY_INFRA_ON_EXIT : true
PAVICS_HOST : https://host-140-154.rdext.crim.ca

PAVICS-e2e-workflow-tests Pipeline Results

Tests URL : http://daccs-jenkins.crim.ca:80/job/PAVICS-e2e-workflow-tests/job/master/1402/

NOTEBOOK TEST RESULTS
    
[2023-11-08T21:07:18.626Z] ============================= test session starts ==============================
[2023-11-08T21:07:18.626Z] platform linux -- Python 3.9.16, pytest-7.3.1, pluggy-1.0.0
[2023-11-08T21:07:18.626Z] rootdir: /home/jenkins/agent/workspace/PAVICS-e2e-workflow-tests_master
[2023-11-08T21:07:18.626Z] plugins: anyio-3.6.1, dash-2.10.0, nbval-0.9.6, tornasync-0.6.0.post2, xdist-3.3.1
[2023-11-08T21:07:18.626Z] collected 255 items
[2023-11-08T21:07:18.626Z] 
[2023-11-08T21:07:29.640Z] notebooks-auth/geoserver.ipynb ..................                        [  7%]
[2023-11-08T21:07:38.080Z] notebooks-auth/test_thredds.ipynb ...........                            [ 11%]
[2023-11-08T21:07:46.292Z] pavics-sdi-master/docs/source/notebooks/WCS_example.ipynb .......        [ 14%]
[2023-11-08T21:07:56.000Z] pavics-sdi-master/docs/source/notebooks/WFS_example.ipynb ......         [ 16%]
[2023-11-08T21:08:03.615Z] pavics-sdi-master/docs/source/notebooks/WMS_example.ipynb ........       [ 19%]
[2023-11-08T21:15:14.182Z] pavics-sdi-master/docs/source/notebooks/climex.ipynb ............        [ 24%]
[2023-11-08T21:15:16.742Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-climate-stations.ipynb . [ 24%]
[2023-11-08T21:15:27.292Z] ...............                                                          [ 30%]
[2023-11-08T21:15:36.689Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-xclim.ipynb .....    [ 32%]
[2023-11-08T21:15:47.208Z] pavics-sdi-master/docs/source/notebooks/esgf-dap.ipynb ......            [ 34%]
[2023-11-08T21:16:02.863Z] pavics-sdi-master/docs/source/notebooks/forecasts.ipynb ......           [ 37%]
[2023-11-08T21:16:04.070Z] pavics-sdi-master/docs/source/notebooks/jupyter_extensions.ipynb .       [ 37%]
[2023-11-08T21:16:12.061Z] pavics-sdi-master/docs/source/notebooks/opendap.ipynb .......            [ 40%]
[2023-11-08T21:16:16.561Z] pavics-sdi-master/docs/source/notebooks/pavics_thredds.ipynb .....       [ 42%]
[2023-11-08T21:19:25.923Z] pavics-sdi-master/docs/source/notebooks/regridding.ipynb ............... [ 48%]
[2023-11-08T21:20:32.896Z] .............                                                            [ 53%]
[2023-11-08T21:20:37.348Z] pavics-sdi-master/docs/source/notebooks/rendering.ipynb ....             [ 54%]
[2023-11-08T21:20:39.568Z] pavics-sdi-master/docs/source/notebooks/subset-user-input.ipynb ........ [ 58%]
[2023-11-08T21:20:54.607Z] .................                                                        [ 64%]
[2023-11-08T21:21:02.226Z] pavics-sdi-master/docs/source/notebooks/subsetting.ipynb ......          [ 67%]
[2023-11-08T21:21:03.611Z] pavics-sdi-master/docs/source/notebook-components/weaver_example.ipynb . [ 67%]
[2023-11-08T21:21:27.804Z] ........F                                                                [ 70%]
[2023-11-08T21:21:36.889Z] finch-master/docs/source/notebooks/dap_subset.ipynb ...........          [ 75%]
[2023-11-08T21:21:45.871Z] finch-master/docs/source/notebooks/finch-usage.ipynb ......              [ 77%]
[2023-11-08T21:21:47.258Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-1DataAccess.ipynb . [ 78%]
[2023-11-08T21:21:50.016Z] ......                                                                   [ 80%]
[2023-11-08T21:21:56.610Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-2Subsetting.ipynb . [ 80%]
[2023-11-08T21:22:10.569Z] .............                                                            [ 85%]
[2023-11-08T21:22:20.587Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-3Climate-Indicators.ipynb . [ 86%]
[2023-11-08T21:22:53.492Z] ....s.                                                                   [ 88%]
[2023-11-08T21:23:00.091Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-4Ensembles.ipynb . [ 89%]
[2023-11-08T21:23:12.618Z] ...                                                                      [ 90%]
[2023-11-08T21:23:27.531Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-5Visualization.ipynb . [ 90%]
[2023-11-08T21:23:46.591Z] ......                                                                   [ 92%]
[2023-11-08T21:23:49.326Z] notebooks/hummingbird.ipynb ............                                 [ 97%]
[2023-11-08T21:26:23.443Z] notebooks/stress-tests.ipynb ......                                      [100%]
[2023-11-08T21:26:23.443Z] 
[2023-11-08T21:26:23.443Z] =================================== FAILURES ===================================
    
  
crim-jenkins-bot commented 1 year ago

E2E Test Results

DACCS-iac Pipeline Results

Build URL : http://daccs-jenkins.crim.ca:80/job/DACCS-iac-birdhouse/2222/
Result : failure

BIRDHOUSE_DEPLOY_BRANCH : limit-magpie-usernames
DACCS_CONFIGS_BRANCH : master
PAVICS_E2E_WORKFLOW_TESTS_BRANCH : master
PAVICS_SDI_BRANCH : master

DESTROY_INFRA_ON_EXIT : true
PAVICS_HOST : https://host-140-46.rdext.crim.ca

PAVICS-e2e-workflow-tests Pipeline Results

Tests URL : http://daccs-jenkins.crim.ca:80/job/PAVICS-e2e-workflow-tests/job/master/1403/

NOTEBOOK TEST RESULTS
    
[2023-11-09T18:06:47.693Z] ============================= test session starts ==============================
[2023-11-09T18:06:47.693Z] platform linux -- Python 3.9.16, pytest-7.3.1, pluggy-1.0.0
[2023-11-09T18:06:47.693Z] rootdir: /home/jenkins/agent/workspace/PAVICS-e2e-workflow-tests_master
[2023-11-09T18:06:47.693Z] plugins: anyio-3.6.1, dash-2.10.0, nbval-0.9.6, tornasync-0.6.0.post2, xdist-3.3.1
[2023-11-09T18:06:47.693Z] collected 255 items
[2023-11-09T18:06:47.693Z] 
[2023-11-09T18:06:58.695Z] notebooks-auth/geoserver.ipynb ..................                        [  7%]
[2023-11-09T18:07:06.840Z] notebooks-auth/test_thredds.ipynb ...........                            [ 11%]
[2023-11-09T18:07:14.829Z] pavics-sdi-master/docs/source/notebooks/WCS_example.ipynb .......        [ 14%]
[2023-11-09T18:07:23.813Z] pavics-sdi-master/docs/source/notebooks/WFS_example.ipynb ......         [ 16%]
[2023-11-09T18:07:33.573Z] pavics-sdi-master/docs/source/notebooks/WMS_example.ipynb ........       [ 19%]
[2023-11-09T18:14:49.568Z] pavics-sdi-master/docs/source/notebooks/climex.ipynb ............        [ 24%]
[2023-11-09T18:14:51.484Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-climate-stations.ipynb . [ 24%]
[2023-11-09T18:14:58.958Z] ...............                                                          [ 30%]
[2023-11-09T18:15:08.377Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-xclim.ipynb .....    [ 32%]
[2023-11-09T18:15:15.021Z] pavics-sdi-master/docs/source/notebooks/esgf-dap.ipynb ......            [ 34%]
[2023-11-09T18:15:31.234Z] pavics-sdi-master/docs/source/notebooks/forecasts.ipynb ......           [ 37%]
[2023-11-09T18:15:32.620Z] pavics-sdi-master/docs/source/notebooks/jupyter_extensions.ipynb .       [ 37%]
[2023-11-09T18:15:37.893Z] pavics-sdi-master/docs/source/notebooks/opendap.ipynb .......            [ 40%]
[2023-11-09T18:15:42.156Z] pavics-sdi-master/docs/source/notebooks/pavics_thredds.ipynb .....       [ 42%]
[2023-11-09T18:20:23.336Z] pavics-sdi-master/docs/source/notebooks/regridding.ipynb ............... [ 48%]
[2023-11-09T18:21:30.922Z] .............                                                            [ 53%]
[2023-11-09T18:21:35.861Z] pavics-sdi-master/docs/source/notebooks/rendering.ipynb ....             [ 54%]
[2023-11-09T18:21:38.198Z] pavics-sdi-master/docs/source/notebooks/subset-user-input.ipynb ........ [ 58%]
[2023-11-09T18:21:53.271Z] .................                                                        [ 64%]
[2023-11-09T18:22:01.376Z] pavics-sdi-master/docs/source/notebooks/subsetting.ipynb ......          [ 67%]
[2023-11-09T18:22:02.760Z] pavics-sdi-master/docs/source/notebook-components/weaver_example.ipynb . [ 67%]
[2023-11-09T18:22:27.091Z] ........F                                                                [ 70%]
[2023-11-09T18:22:36.018Z] finch-master/docs/source/notebooks/dap_subset.ipynb ...........          [ 75%]
[2023-11-09T18:22:45.337Z] finch-master/docs/source/notebooks/finch-usage.ipynb ......              [ 77%]
[2023-11-09T18:22:47.261Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-1DataAccess.ipynb . [ 78%]
[2023-11-09T18:22:50.075Z] ......                                                                   [ 80%]
[2023-11-09T18:22:58.212Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-2Subsetting.ipynb . [ 80%]
[2023-11-09T18:23:12.696Z] .............                                                            [ 85%]
[2023-11-09T18:23:22.687Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-3Climate-Indicators.ipynb . [ 86%]
[2023-11-09T18:23:57.653Z] ....s.                                                                   [ 88%]
[2023-11-09T18:24:05.801Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-4Ensembles.ipynb . [ 89%]
[2023-11-09T18:24:20.555Z] ...                                                                      [ 90%]
[2023-11-09T18:24:32.798Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-5Visualization.ipynb . [ 90%]
[2023-11-09T18:24:57.291Z] ......                                                                   [ 92%]
[2023-11-09T18:24:58.397Z] notebooks/hummingbird.ipynb ............                                 [ 97%]
[2023-11-09T18:27:33.021Z] notebooks/stress-tests.ipynb ......                                      [100%]
[2023-11-09T18:27:33.021Z] 
[2023-11-09T18:27:33.021Z] =================================== FAILURES ===================================
    
  
crim-jenkins-bot commented 1 year ago

E2E Test Results

DACCS-iac Pipeline Results

Build URL : http://daccs-jenkins.crim.ca:80/job/DACCS-iac-birdhouse/2235/
Result : failure

BIRDHOUSE_DEPLOY_BRANCH : limit-magpie-usernames
DACCS_CONFIGS_BRANCH : master
PAVICS_E2E_WORKFLOW_TESTS_BRANCH : master
PAVICS_SDI_BRANCH : master

DESTROY_INFRA_ON_EXIT : true
PAVICS_HOST : https://host-140-154.rdext.crim.ca

PAVICS-e2e-workflow-tests Pipeline Results

Tests URL : http://daccs-jenkins.crim.ca:80/job/PAVICS-e2e-workflow-tests/job/master/1412/

NOTEBOOK TEST RESULTS
    
[2023-11-11T02:26:18.078Z] ============================= test session starts ==============================
[2023-11-11T02:26:18.078Z] platform linux -- Python 3.9.16, pytest-7.3.1, pluggy-1.0.0
[2023-11-11T02:26:18.079Z] rootdir: /home/jenkins/agent/workspace/PAVICS-e2e-workflow-tests_master
[2023-11-11T02:26:18.079Z] plugins: anyio-3.6.1, dash-2.10.0, nbval-0.9.6, tornasync-0.6.0.post2, xdist-3.3.1
[2023-11-11T02:26:18.079Z] collected 255 items
[2023-11-11T02:26:18.079Z] 
[2023-11-11T02:26:27.920Z] notebooks-auth/geoserver.ipynb ..................                        [  7%]
[2023-11-11T02:26:35.725Z] notebooks-auth/test_thredds.ipynb ...........                            [ 11%]
[2023-11-11T02:26:44.192Z] pavics-sdi-master/docs/source/notebooks/WCS_example.ipynb .......        [ 14%]
[2023-11-11T02:26:53.896Z] pavics-sdi-master/docs/source/notebooks/WFS_example.ipynb ......         [ 16%]
[2023-11-11T02:26:59.607Z] pavics-sdi-master/docs/source/notebooks/WMS_example.ipynb .FFFFFFF       [ 19%]
[2023-11-11T02:34:10.908Z] pavics-sdi-master/docs/source/notebooks/climex.ipynb ............        [ 24%]
[2023-11-11T02:34:10.908Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-climate-stations.ipynb . [ 24%]
[2023-11-11T02:34:16.310Z] ...............                                                          [ 30%]
[2023-11-11T02:34:25.704Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-xclim.ipynb .....    [ 32%]
[2023-11-11T02:34:32.464Z] pavics-sdi-master/docs/source/notebooks/esgf-dap.ipynb ......            [ 34%]
[2023-11-11T02:34:48.848Z] pavics-sdi-master/docs/source/notebooks/forecasts.ipynb ......           [ 37%]
[2023-11-11T02:34:50.509Z] pavics-sdi-master/docs/source/notebooks/jupyter_extensions.ipynb .       [ 37%]
[2023-11-11T02:34:58.755Z] pavics-sdi-master/docs/source/notebooks/opendap.ipynb .......            [ 40%]
[2023-11-11T02:35:03.541Z] pavics-sdi-master/docs/source/notebooks/pavics_thredds.ipynb .....       [ 42%]
[2023-11-11T02:38:04.197Z] pavics-sdi-master/docs/source/notebooks/regridding.ipynb ............... [ 48%]
[2023-11-11T02:39:51.964Z] .............                                                            [ 53%]
[2023-11-11T02:39:53.070Z] pavics-sdi-master/docs/source/notebooks/rendering.ipynb ....             [ 54%]
[2023-11-11T02:39:55.309Z] pavics-sdi-master/docs/source/notebooks/subset-user-input.ipynb ........ [ 58%]
[2023-11-11T02:40:21.284Z] .................                                                        [ 64%]
[2023-11-11T02:40:29.176Z] pavics-sdi-master/docs/source/notebooks/subsetting.ipynb ......          [ 67%]
[2023-11-11T02:40:30.558Z] pavics-sdi-master/docs/source/notebook-components/weaver_example.ipynb . [ 67%]
[2023-11-11T02:40:42.434Z] ........F                                                                [ 70%]
[2023-11-11T02:40:53.954Z] finch-master/docs/source/notebooks/dap_subset.ipynb ...........          [ 75%]
[2023-11-11T02:41:03.236Z] finch-master/docs/source/notebooks/finch-usage.ipynb ......              [ 77%]
[2023-11-11T02:41:05.779Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-1DataAccess.ipynb . [ 78%]
[2023-11-11T02:41:12.411Z] ......                                                                   [ 80%]
[2023-11-11T02:41:51.152Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-2Subsetting.ipynb . [ 80%]
[2023-11-11T02:42:39.758Z] .............                                                            [ 85%]
[2023-11-11T02:42:54.673Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-3Climate-Indicators.ipynb . [ 86%]
[2023-11-11T02:43:55.685Z] ....s.                                                                   [ 88%]
[2023-11-11T02:44:03.841Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-4Ensembles.ipynb . [ 89%]
[2023-11-11T02:44:20.254Z] ...                                                                      [ 90%]
[2023-11-11T02:44:35.180Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-5Visualization.ipynb . [ 90%]
[2023-11-11T02:44:59.694Z] ......                                                                   [ 92%]
[2023-11-11T02:45:02.122Z] notebooks/hummingbird.ipynb ............                                 [ 97%]
[2023-11-11T02:47:36.224Z] notebooks/stress-tests.ipynb ......                                      [100%]
[2023-11-11T02:47:36.224Z] 
[2023-11-11T02:47:36.224Z] =================================== FAILURES ===================================
    
  
crim-jenkins-bot commented 1 year ago

E2E Test Results

DACCS-iac Pipeline Results

Build URL : http://daccs-jenkins.crim.ca:80/job/DACCS-iac-birdhouse/2236/
Result : failure

BIRDHOUSE_DEPLOY_BRANCH : limit-magpie-usernames
DACCS_CONFIGS_BRANCH : master
PAVICS_E2E_WORKFLOW_TESTS_BRANCH : master
PAVICS_SDI_BRANCH : master

DESTROY_INFRA_ON_EXIT : true
PAVICS_HOST : https://host-140-133.rdext.crim.ca

PAVICS-e2e-workflow-tests Pipeline Results

Tests URL : http://daccs-jenkins.crim.ca:80/job/PAVICS-e2e-workflow-tests/job/master/1413/

NOTEBOOK TEST RESULTS
    
[2023-11-11T02:36:47.403Z] ============================= test session starts ==============================
[2023-11-11T02:36:47.403Z] platform linux -- Python 3.9.16, pytest-7.3.1, pluggy-1.0.0
[2023-11-11T02:36:47.403Z] rootdir: /home/jenkins/agent/workspace/PAVICS-e2e-workflow-tests_master@2
[2023-11-11T02:36:47.403Z] plugins: anyio-3.6.1, dash-2.10.0, nbval-0.9.6, tornasync-0.6.0.post2, xdist-3.3.1
[2023-11-11T02:36:47.403Z] collected 255 items
[2023-11-11T02:36:47.403Z] 
[2023-11-11T02:36:59.607Z] notebooks-auth/geoserver.ipynb ..................                        [  7%]
[2023-11-11T02:37:07.582Z] notebooks-auth/test_thredds.ipynb ...........                            [ 11%]
[2023-11-11T02:37:15.145Z] pavics-sdi-master/docs/source/notebooks/WCS_example.ipynb .......        [ 14%]
[2023-11-11T02:37:24.193Z] pavics-sdi-master/docs/source/notebooks/WFS_example.ipynb ......         [ 16%]
[2023-11-11T02:37:29.612Z] pavics-sdi-master/docs/source/notebooks/WMS_example.ipynb ......FF       [ 19%]
[2023-11-11T02:44:47.248Z] pavics-sdi-master/docs/source/notebooks/climex.ipynb ............        [ 24%]
[2023-11-11T02:44:47.248Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-climate-stations.ipynb . [ 24%]
[2023-11-11T02:44:51.065Z] ...............                                                          [ 30%]
[2023-11-11T02:45:00.723Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-xclim.ipynb .....    [ 32%]
[2023-11-11T02:45:07.633Z] pavics-sdi-master/docs/source/notebooks/esgf-dap.ipynb ......            [ 34%]
[2023-11-11T02:45:23.800Z] pavics-sdi-master/docs/source/notebooks/forecasts.ipynb ......           [ 37%]
[2023-11-11T02:45:25.454Z] pavics-sdi-master/docs/source/notebooks/jupyter_extensions.ipynb .       [ 37%]
[2023-11-11T02:45:30.512Z] pavics-sdi-master/docs/source/notebooks/opendap.ipynb .......            [ 40%]
[2023-11-11T02:45:35.029Z] pavics-sdi-master/docs/source/notebooks/pavics_thredds.ipynb .....       [ 42%]
[2023-11-11T02:48:16.794Z] pavics-sdi-master/docs/source/notebooks/regridding.ipynb ............... [ 48%]
[2023-11-11T02:49:32.371Z] .............                                                            [ 53%]
[2023-11-11T02:49:35.932Z] pavics-sdi-master/docs/source/notebooks/rendering.ipynb ....             [ 54%]
[2023-11-11T02:49:38.406Z] pavics-sdi-master/docs/source/notebooks/subset-user-input.ipynb ........ [ 58%]
[2023-11-11T02:49:54.871Z] .................                                                        [ 64%]
[2023-11-11T02:50:02.674Z] pavics-sdi-master/docs/source/notebooks/subsetting.ipynb ......          [ 67%]
[2023-11-11T02:50:04.055Z] pavics-sdi-master/docs/source/notebook-components/weaver_example.ipynb . [ 67%]
[2023-11-11T02:50:22.116Z] ........F                                                                [ 70%]
[2023-11-11T02:50:31.470Z] finch-master/docs/source/notebooks/dap_subset.ipynb ...........          [ 75%]
[2023-11-11T02:50:40.806Z] finch-master/docs/source/notebooks/finch-usage.ipynb ......              [ 77%]
[2023-11-11T02:50:42.210Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-1DataAccess.ipynb . [ 78%]
[2023-11-11T02:50:45.018Z] ......                                                                   [ 80%]
[2023-11-11T02:50:51.594Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-2Subsetting.ipynb . [ 80%]
[2023-11-11T02:51:06.097Z] .............                                                            [ 85%]
[2023-11-11T02:51:16.095Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-3Climate-Indicators.ipynb . [ 86%]
[2023-11-11T02:51:50.547Z] ....s.                                                                   [ 88%]
[2023-11-11T02:51:58.694Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-4Ensembles.ipynb . [ 89%]
[2023-11-11T02:52:14.226Z] ...                                                                      [ 90%]
[2023-11-11T02:52:26.463Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-5Visualization.ipynb . [ 90%]
[2023-11-11T02:52:50.356Z] ......                                                                   [ 92%]
[2023-11-11T02:52:52.287Z] notebooks/hummingbird.ipynb ............                                 [ 97%]
[2023-11-11T02:55:31.891Z] notebooks/stress-tests.ipynb ......                                      [100%]
[2023-11-11T02:55:31.891Z] 
[2023-11-11T02:55:31.892Z] =================================== FAILURES ===================================
    
  
mishaschwartz commented 12 months ago

Now that I think about it though, isn't overriding escape_name() to return self.user.name the same as simply using {raw_username}? Why overriding when we can simply use {raw_username}?

This only works in the places where jupyterhub allows you to specify {raw_username} in a template. We want to ensure that this applied in all cases (not just when mounting user workspaces to the container)

crim-jenkins-bot commented 12 months ago

E2E Test Results

DACCS-iac Pipeline Results

Build URL : http://daccs-jenkins.crim.ca:80/job/DACCS-iac-birdhouse/2308/
Result : failure

BIRDHOUSE_DEPLOY_BRANCH : limit-magpie-usernames
DACCS_CONFIGS_BRANCH : master
PAVICS_E2E_WORKFLOW_TESTS_BRANCH : master
PAVICS_SDI_BRANCH : master

DESTROY_INFRA_ON_EXIT : true
PAVICS_HOST : https://host-140-154.rdext.crim.ca

PAVICS-e2e-workflow-tests Pipeline Results

Tests URL : http://daccs-jenkins.crim.ca:80/job/PAVICS-e2e-workflow-tests/job/master/1438/

NOTEBOOK TEST RESULTS
    
[2023-11-27T20:42:07.220Z] ============================= test session starts ==============================
[2023-11-27T20:42:07.220Z] platform linux -- Python 3.9.16, pytest-7.3.1, pluggy-1.0.0
[2023-11-27T20:42:07.220Z] rootdir: /home/jenkins/agent/workspace/PAVICS-e2e-workflow-tests_master
[2023-11-27T20:42:07.220Z] plugins: anyio-3.6.1, dash-2.10.0, nbval-0.9.6, tornasync-0.6.0.post2, xdist-3.3.1
[2023-11-27T20:42:07.220Z] collected 255 items
[2023-11-27T20:42:07.220Z] 
[2023-11-27T20:42:18.718Z] notebooks-auth/geoserver.ipynb ..................                        [  7%]
[2023-11-27T20:42:27.142Z] notebooks-auth/test_thredds.ipynb ...........                            [ 11%]
[2023-11-27T20:42:35.728Z] pavics-sdi-master/docs/source/notebooks/WCS_example.ipynb .......        [ 14%]
[2023-11-27T20:42:45.847Z] pavics-sdi-master/docs/source/notebooks/WFS_example.ipynb ......         [ 16%]
[2023-11-27T20:42:55.820Z] pavics-sdi-master/docs/source/notebooks/WMS_example.ipynb ........       [ 19%]
[2023-11-27T20:50:22.928Z] pavics-sdi-master/docs/source/notebooks/climex.ipynb ............        [ 24%]
[2023-11-27T20:50:22.928Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-climate-stations.ipynb . [ 24%]
[2023-11-27T20:50:32.806Z] ...............                                                          [ 30%]
[2023-11-27T20:50:42.516Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-xclim.ipynb .....    [ 32%]
[2023-11-27T20:50:50.770Z] pavics-sdi-master/docs/source/notebooks/esgf-dap.ipynb ......            [ 34%]
[2023-11-27T20:51:07.260Z] pavics-sdi-master/docs/source/notebooks/forecasts.ipynb ......           [ 37%]
[2023-11-27T20:51:08.644Z] pavics-sdi-master/docs/source/notebooks/jupyter_extensions.ipynb .       [ 37%]
[2023-11-27T20:51:13.605Z] pavics-sdi-master/docs/source/notebooks/opendap.ipynb .......            [ 40%]
[2023-11-27T20:51:18.188Z] pavics-sdi-master/docs/source/notebooks/pavics_thredds.ipynb .....       [ 42%]
[2023-11-27T20:54:50.784Z] pavics-sdi-master/docs/source/notebooks/regridding.ipynb ............... [ 48%]
[2023-11-27T20:56:08.710Z] .............                                                            [ 53%]
[2023-11-27T20:56:11.192Z] pavics-sdi-master/docs/source/notebooks/rendering.ipynb ....             [ 54%]
[2023-11-27T20:56:13.427Z] pavics-sdi-master/docs/source/notebooks/subset-user-input.ipynb ........ [ 58%]
[2023-11-27T20:56:30.261Z] .................                                                        [ 64%]
[2023-11-27T20:56:37.709Z] pavics-sdi-master/docs/source/notebooks/subsetting.ipynb ......          [ 67%]
[2023-11-27T20:56:39.093Z] pavics-sdi-master/docs/source/notebook-components/weaver_example.ipynb . [ 67%]
[2023-11-27T20:56:40.461Z] .FFFFFFFF                                                                [ 70%]
[2023-11-27T20:56:51.046Z] finch-master/docs/source/notebooks/dap_subset.ipynb ...........          [ 75%]
[2023-11-27T20:57:00.770Z] finch-master/docs/source/notebooks/finch-usage.ipynb ......              [ 77%]
[2023-11-27T20:57:02.158Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-1DataAccess.ipynb . [ 78%]
[2023-11-27T20:57:05.465Z] ......                                                                   [ 80%]
[2023-11-27T20:57:13.624Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-2Subsetting.ipynb . [ 80%]
[2023-11-27T20:57:27.745Z] .............                                                            [ 85%]
[2023-11-27T20:57:37.755Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-3Climate-Indicators.ipynb . [ 86%]
[2023-11-27T20:58:14.351Z] ....s.                                                                   [ 88%]
[2023-11-27T20:58:22.484Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-4Ensembles.ipynb . [ 89%]
[2023-11-27T20:58:37.249Z] ...                                                                      [ 90%]
[2023-11-27T20:58:52.146Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-5Visualization.ipynb . [ 90%]
[2023-11-27T20:59:12.762Z] ......                                                                   [ 92%]
[2023-11-27T20:59:15.625Z] notebooks/hummingbird.ipynb ............                                 [ 97%]
[2023-11-27T21:02:01.497Z] notebooks/stress-tests.ipynb ......                                      [100%]
[2023-11-27T21:02:01.497Z] 
[2023-11-27T21:02:01.497Z] =================================== FAILURES ===================================
    
  
crim-jenkins-bot commented 12 months ago

E2E Test Results

DACCS-iac Pipeline Results

Build URL : http://daccs-jenkins.crim.ca:80/job/DACCS-iac-birdhouse/2311/
Result : failure

BIRDHOUSE_DEPLOY_BRANCH : limit-magpie-usernames
DACCS_CONFIGS_BRANCH : master
PAVICS_E2E_WORKFLOW_TESTS_BRANCH : master
PAVICS_SDI_BRANCH : master

DESTROY_INFRA_ON_EXIT : true
PAVICS_HOST : https://host-140-154.rdext.crim.ca

PAVICS-e2e-workflow-tests Pipeline Results

Tests URL : http://daccs-jenkins.crim.ca:80/job/PAVICS-e2e-workflow-tests/job/master/1440/

NOTEBOOK TEST RESULTS
    
[2023-11-28T18:36:35.651Z] ============================= test session starts ==============================
[2023-11-28T18:36:35.651Z] platform linux -- Python 3.9.16, pytest-7.3.1, pluggy-1.0.0
[2023-11-28T18:36:35.651Z] rootdir: /home/jenkins/agent/workspace/PAVICS-e2e-workflow-tests_master
[2023-11-28T18:36:35.651Z] plugins: anyio-3.6.1, dash-2.10.0, nbval-0.9.6, tornasync-0.6.0.post2, xdist-3.3.1
[2023-11-28T18:36:35.651Z] collected 255 items
[2023-11-28T18:36:35.651Z] 
[2023-11-28T18:36:45.759Z] notebooks-auth/geoserver.ipynb ..................                        [  7%]
[2023-11-28T18:36:53.256Z] notebooks-auth/test_thredds.ipynb ...........                            [ 11%]
[2023-11-28T18:37:01.854Z] pavics-sdi-master/docs/source/notebooks/WCS_example.ipynb .......        [ 14%]
[2023-11-28T18:37:10.516Z] pavics-sdi-master/docs/source/notebooks/WFS_example.ipynb ......         [ 16%]
[2023-11-28T18:37:19.597Z] pavics-sdi-master/docs/source/notebooks/WMS_example.ipynb ........       [ 19%]
[2023-11-28T18:58:06.372Z] pavics-sdi-master/docs/source/notebooks/climex.ipynb ............        [ 24%]
[2023-11-28T18:58:06.372Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-climate-stations.ipynb . [ 24%]
[2023-11-28T18:58:16.478Z] ...............                                                          [ 30%]
[2023-11-28T18:58:25.881Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-xclim.ipynb .....    [ 32%]
[2023-11-28T18:58:33.443Z] pavics-sdi-master/docs/source/notebooks/esgf-dap.ipynb ......            [ 34%]
[2023-11-28T18:58:48.827Z] pavics-sdi-master/docs/source/notebooks/forecasts.ipynb ......           [ 37%]
[2023-11-28T18:58:50.217Z] pavics-sdi-master/docs/source/notebooks/jupyter_extensions.ipynb .       [ 37%]
[2023-11-28T18:58:55.506Z] pavics-sdi-master/docs/source/notebooks/opendap.ipynb .......            [ 40%]
[2023-11-28T18:58:59.769Z] pavics-sdi-master/docs/source/notebooks/pavics_thredds.ipynb .....       [ 42%]
[2023-11-28T19:02:44.819Z] pavics-sdi-master/docs/source/notebooks/regridding.ipynb ............... [ 48%]
[2023-11-28T19:04:07.687Z] .............                                                            [ 53%]
[2023-11-28T19:04:12.411Z] pavics-sdi-master/docs/source/notebooks/rendering.ipynb ....             [ 54%]
[2023-11-28T19:04:14.548Z] pavics-sdi-master/docs/source/notebooks/subset-user-input.ipynb ........ [ 58%]
[2023-11-28T19:04:29.866Z] .................                                                        [ 64%]
[2023-11-28T19:04:37.460Z] pavics-sdi-master/docs/source/notebooks/subsetting.ipynb ......          [ 67%]
[2023-11-28T19:04:39.373Z] pavics-sdi-master/docs/source/notebook-components/weaver_example.ipynb . [ 67%]
[2023-11-28T19:05:52.512Z] ......FFF                                                                [ 70%]
[2023-11-28T19:06:03.358Z] finch-master/docs/source/notebooks/dap_subset.ipynb ...........          [ 75%]
[2023-11-28T19:06:11.719Z] finch-master/docs/source/notebooks/finch-usage.ipynb ......              [ 77%]
[2023-11-28T19:06:13.104Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-1DataAccess.ipynb . [ 78%]
[2023-11-28T19:06:16.185Z] ......                                                                   [ 80%]
[2023-11-28T19:06:22.766Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-2Subsetting.ipynb . [ 80%]
[2023-11-28T19:06:36.266Z] .............                                                            [ 85%]
[2023-11-28T19:06:46.271Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-3Climate-Indicators.ipynb . [ 86%]
[2023-11-28T19:07:43.006Z] ....s.                                                                   [ 88%]
[2023-11-28T19:07:51.173Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-4Ensembles.ipynb . [ 89%]
[2023-11-28T19:08:06.735Z] ...                                                                      [ 90%]
[2023-11-28T19:08:18.981Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-5Visualization.ipynb . [ 90%]
[2023-11-28T19:08:41.593Z] ......                                                                   [ 92%]
[2023-11-28T19:08:44.593Z] notebooks/hummingbird.ipynb ............                                 [ 97%]
[2023-11-28T19:11:18.759Z] notebooks/stress-tests.ipynb ......                                      [100%]
[2023-11-28T19:11:18.759Z] 
[2023-11-28T19:11:18.759Z] =================================== FAILURES ===================================
    
  
crim-jenkins-bot commented 12 months ago

E2E Test Results

DACCS-iac Pipeline Results

Build URL : http://daccs-jenkins.crim.ca:80/job/DACCS-iac-birdhouse/2314/
Result : failure

BIRDHOUSE_DEPLOY_BRANCH : limit-magpie-usernames
DACCS_CONFIGS_BRANCH : master
PAVICS_E2E_WORKFLOW_TESTS_BRANCH : master
PAVICS_SDI_BRANCH : master

DESTROY_INFRA_ON_EXIT : true
PAVICS_HOST : https://host-140-133.rdext.crim.ca

PAVICS-e2e-workflow-tests Pipeline Results

Tests URL : http://daccs-jenkins.crim.ca:80/job/PAVICS-e2e-workflow-tests/job/master/1443/

NOTEBOOK TEST RESULTS
    
[2023-11-29T17:16:57.409Z] ============================= test session starts ==============================
[2023-11-29T17:16:57.409Z] platform linux -- Python 3.9.16, pytest-7.3.1, pluggy-1.0.0
[2023-11-29T17:16:57.409Z] rootdir: /home/jenkins/agent/workspace/PAVICS-e2e-workflow-tests_master@2
[2023-11-29T17:16:57.409Z] plugins: anyio-3.6.1, dash-2.10.0, nbval-0.9.6, tornasync-0.6.0.post2, xdist-3.3.1
[2023-11-29T17:16:57.409Z] collected 255 items
[2023-11-29T17:16:57.409Z] 
[2023-11-29T17:17:06.685Z] notebooks-auth/geoserver.ipynb ..............F...                        [  7%]
[2023-11-29T17:17:14.466Z] notebooks-auth/test_thredds.ipynb ...........                            [ 11%]
[2023-11-29T17:17:22.375Z] pavics-sdi-master/docs/source/notebooks/WCS_example.ipynb .......        [ 14%]
[2023-11-29T17:17:59.736Z] pavics-sdi-master/docs/source/notebooks/WFS_example.ipynb ......         [ 16%]
[2023-11-29T17:18:07.343Z] pavics-sdi-master/docs/source/notebooks/WMS_example.ipynb ........       [ 19%]
[2023-11-29T17:43:39.580Z] pavics-sdi-master/docs/source/notebooks/climex.ipynb ............        [ 24%]
[2023-11-29T17:43:39.580Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-climate-stations.ipynb . [ 24%]
[2023-11-29T17:43:43.980Z] ...............                                                          [ 30%]
[2023-11-29T17:43:54.785Z] pavics-sdi-master/docs/source/notebooks/eccc-geoapi-xclim.ipynb .....    [ 32%]
[2023-11-29T17:44:02.155Z] pavics-sdi-master/docs/source/notebooks/esgf-dap.ipynb ......            [ 34%]
[2023-11-29T17:44:18.624Z] pavics-sdi-master/docs/source/notebooks/forecasts.ipynb ......           [ 37%]
[2023-11-29T17:44:20.268Z] pavics-sdi-master/docs/source/notebooks/jupyter_extensions.ipynb .       [ 37%]
[2023-11-29T17:44:25.310Z] pavics-sdi-master/docs/source/notebooks/opendap.ipynb .......            [ 40%]
[2023-11-29T17:44:30.029Z] pavics-sdi-master/docs/source/notebooks/pavics_thredds.ipynb .....       [ 42%]
[2023-11-29T17:47:29.163Z] pavics-sdi-master/docs/source/notebooks/regridding.ipynb ............... [ 48%]
[2023-11-29T17:48:57.148Z] .............                                                            [ 53%]
[2023-11-29T17:48:59.881Z] pavics-sdi-master/docs/source/notebooks/rendering.ipynb ....             [ 54%]
[2023-11-29T17:49:02.114Z] pavics-sdi-master/docs/source/notebooks/subset-user-input.ipynb ........ [ 58%]
[2023-11-29T17:49:18.617Z] .................                                                        [ 64%]
[2023-11-29T17:49:25.786Z] pavics-sdi-master/docs/source/notebooks/subsetting.ipynb ......          [ 67%]
[2023-11-29T17:49:27.166Z] pavics-sdi-master/docs/source/notebook-components/weaver_example.ipynb . [ 67%]
[2023-11-29T17:49:45.508Z] .........                                                                [ 70%]
[2023-11-29T17:49:54.948Z] finch-master/docs/source/notebooks/dap_subset.ipynb ...........          [ 75%]
[2023-11-29T17:50:04.280Z] finch-master/docs/source/notebooks/finch-usage.ipynb ......              [ 77%]
[2023-11-29T17:50:05.660Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-1DataAccess.ipynb . [ 78%]
[2023-11-29T17:50:14.160Z] ......                                                                   [ 80%]
[2023-11-29T17:50:46.285Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-2Subsetting.ipynb . [ 80%]
[2023-11-29T17:52:57.701Z] .............                                                            [ 85%]
[2023-11-29T17:53:29.812Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-3Climate-Indicators.ipynb . [ 86%]
[2023-11-29T17:54:06.396Z] ....s.                                                                   [ 88%]
[2023-11-29T17:54:14.534Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-4Ensembles.ipynb . [ 89%]
[2023-11-29T17:54:27.827Z] ...                                                                      [ 90%]
[2023-11-29T17:54:42.744Z] PAVICS-landing-master/content/notebooks/climate_indicators/PAVICStutorial_ClimateDataAnalysis-5Visualization.ipynb . [ 90%]
[2023-11-29T17:55:06.094Z] ......                                                                   [ 92%]
[2023-11-29T17:55:07.768Z] notebooks/hummingbird.ipynb ............                                 [ 97%]
[2023-11-29T17:57:47.348Z] notebooks/stress-tests.ipynb ......                                      [100%]
[2023-11-29T17:57:47.348Z] 
[2023-11-29T17:57:47.348Z] =================================== FAILURES ===================================