AllenInstitute / ophys_nway_matching

Other
4 stars 0 forks source link

nway devops #39

Closed djkapner closed 4 years ago

djkapner commented 4 years ago

Tasks

Validation

djkapner commented 4 years ago

I disabled http://bamboo.corp.alleninstitute.org/browse/IFR-OP I can't disable the deployment in the same way, but I think it won't get triggered with the build plan disabled.

djkapner commented 4 years ago

Reran a mesoscope container:

----------------------------------------
Begin PBS Prologue Mon Sep 14 12:57:50 PDT 2020 1600113470
Job ID: 25267507.qmaster2.corp.alleninstitute.org
Username: mongrel
Group: mongrel
Nodes: n78
End PBS Prologue Mon Sep 14 12:57:50 PDT 2020 1600113470
----------------------------------------
time="2020-09-14T12:57:51-07:00" level=warning msg="\"/run/user/301\" directory set by $XDG_RUNTIME_DIR does not exist. Either create the directory or unset $XDG_RUNTIME_DIR.: stat /run/user/301: no such file or directory: Trying to pull image in the event that it is a public image."
INFO:  Converting OCI blobs to SIF format
INFO:  Starting build...
time="2020-09-14T12:57:52-07:00" level=warning msg="\"/run/user/301\" directory set by $XDG_RUNTIME_DIR does not exist. Either create the directory or unset $XDG_RUNTIME_DIR.: stat /run/user/301: no such file or directory: Trying to pull image in the event that it is a public image."
time="2020-09-14T12:57:53-07:00" level=warning msg="\"/run/user/301\" directory set by $XDG_RUNTIME_DIR does not exist. Either create the directory or unset $XDG_RUNTIME_DIR.: stat /run/user/301: no such file or directory: Trying to pull image in the event that it is a public image."
Getting image source signatures
Skipping fetch of repeat blob sha256:57df1a1f1ad841deaf50c8f662d77e93b4b17af776ed66148116607f9aceffa8
Skipping fetch of repeat blob sha256:71e126169501d71bbbd0d3c8d9f35836c41660869fe8432ac606341ed21f7adb
Skipping fetch of repeat blob sha256:1af28a55c3f320826db8df3146a2c198f9042877ef679f9e32210aa9a7fac9ef
Skipping fetch of repeat blob sha256:03f1c9932170e54fface2382b2550b8052ae3d41f27e66ea1294e2055dd2b2e7
Skipping fetch of repeat blob sha256:65b3db15f518f11e53c95664d0675a5d78a5329d18d5316a406c2a45907a0723
Skipping fetch of repeat blob sha256:3e3b8947ed83f2a39a813e0a9172cfdd571d4c943228a74e833af60e7536cac5
Skipping fetch of repeat blob sha256:a4850b8bdbb7b624a1aaf5892b7409d5ae64f8dfdbb19e3017cf6e7fbbfb0ef9
Skipping fetch of repeat blob sha256:41653399496823f7855fe3bf2725fe0a1b79f2da59db9f3b8d5d9a5177c896ae
Skipping fetch of repeat blob sha256:1b580f9ce4cedf9f911da821c8445cd807bc29a7ab3cc62937b87604138dbfa8
Copying blob sha256:004ed858d3d13bbb8de267ee693aff3041cd7d408eb5320d052cf676e6d27330
0 B / 82.88 MiB 20.62 MiB / 82.88 MiB 40.78 MiB / 82.88 MiB 63.50 MiB / 82.88 MiB 82.88 MiB / 82.88 MiB 82.88 MiB / 82.88 MiB 0s
Copying blob sha256:aa15bcdc65dbbf2a59b73924bf4c2cc6c6bc753f1e0f1a78abf3855be87974aa
0 B / 3.20 MiB 3.20 MiB / 3.20 MiB 0s
Copying blob sha256:96373b317e4bb3e79f5738bd0743d5fc939a02cc18c6ca980d418a61a93d728f
0 B / 281.65 MiB 23.78 MiB / 281.65 MiB 48.25 MiB / 281.65 MiB 61.42 MiB / 281.65 MiB 75.40 MiB / 281.65 MiB 88.72 MiB / 281.65 MiB 104.80 MiB / 281.65 MiB 117.97 MiB / 281.65 MiB 133.21 MiB / 281.65 MiB 151.04 MiB / 281.65 MiB 174.81 MiB / 281.65 MiB 201.65 MiB / 281.65 MiB 224.48 MiB / 281.65 MiB 246.57 MiB / 281.65 MiB 273.21 MiB / 281.65 MiB 281.65 MiB / 281.65 MiB 281.65 MiB / 281.65 MiB 281.65 MiB / 281.65 MiB 3s
Copying config sha256:7249b7b2bdc5df11acf4a63f7642fae357eb16c3f03efb41914b8cd0800b1ddf
0 B / 8.01 KiB 8.01 KiB / 8.01 KiB 0s
Writing manifest to image destination
Storing signatures
INFO:  Creating SIF file...
INFO:  Build complete: /allen/ai/hpc/singularity/oci-tmp/08e7f133c74018747999f7a6a85ba5dc32adda9ba78369c26f3d6d34bccbcdda/ophys_nway_matching_master.sif
INFO:  Image cached as SIF at /allen/ai/hpc/singularity/oci-tmp/08e7f133c74018747999f7a6a85ba5dc32adda9ba78369c26f3d6d34bccbcdda/ophys_nway_matching_master.sif
WARNING:root:setting Dict fields not supported from argparse
/usr/local/lib/python3.8/site-packages/argschema/utils.py:346: FutureWarning: '--fixed.cell_rois' is using old-style command-line syntax with each element as a separate argument. This will not be supported in argschema after 2.0. See http://argschema.readthedocs.io/en/master/user/intro.html#command-line-specification for details.
warnings.warn(warn_msg, FutureWarning)
/usr/local/lib/python3.8/site-packages/argschema/utils.py:346: FutureWarning: '--moving.cell_rois' is using old-style command-line syntax with each element as a separate argument. This will not be supported in argschema after 2.0. See http://argschema.readthedocs.io/en/master/user/intro.html#command-line-specification for details.
warnings.warn(warn_msg, FutureWarning)
INFO:__main__:Nway matching is done!
INFO:__main__:wrote /allen/programs/braintv/production/neuralcoding/prod0/specimen_791855403/experiment_container_1018027580/OphysNwayCellMatchingStrategy/container_run_1050273619/1018027580_ophys_cell_matching_output.json
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 39 0 26 100 13 88 44 --:--:-- --:--:-- --:--:-- 89
{"message":"finished job"}----------------------------------------
Begin PBS Epilogue Mon Sep 14 13:03:17 PDT 2020 1600113797
Job ID: 25267507.qmaster2.corp.alleninstitute.org
Username: mongrel
Group: mongrel
Job Name: OPHYS_NWAY_CELL_MATCHING_QUEUE_1018027580
Session: 3167
Limits: mem=148gb,vmem=148gb,walltime=05:00:00,neednodes=centos
Resources: cput=00:05:07,vmem=5795224kb,walltime=00:05:22,mem=4571364kb,energy_used=0
Queue: braintv
Account:
Exit status: 0
Nodes: n78
Killing leftovers...

End PBS Epilogue Mon Sep 14 13:03:27 PDT 2020 1600113807
----------------------------------------
djkapner commented 4 years ago

Checked that the resulting registration was good (previously these overlays showed duplicate offset images): image.png