search

niaid / image_portal_workflows

Workflows related to project previously referred to as "Hedwig"
BSD 3-Clause "New" or "Revised" License
5 stars 1 forks source link

Run error in Prod - 2D pipeline - 7/6/2023 #238

Closed NetaFG closed 1 year ago

NetaFG commented 1 year ago

The pipreline run: https://prefect1.hedwig-workflow-api.niaidprod.net/default/flow-run/b1c406b5-0883-4940-b300-ef594997e5b5?overview The error message: image

NetaFG commented 1 year ago

This is the parallel in in QA: UI https://hedwig2qa.niaid.nih.gov/sessions/U2Vzc2lvbjoyMjU4/samples#N4IgygpgzlCWD2A7AMrKAXWiDmIBcoAagKIBKYAkgPIBy+AjADQiECCyAqsfqAIYyxsiCABMw6XgDNJAMVgAbdBABO+ANoBdZgAdYcxSvVaQUCPIgBjJSIAqAT23QjzU72UWAFuOVZceE7wAttrmAPqIQRAgzABusBAA7vaO+AAMzG4Q+krKUGAe8AmI+OjKAK4QLvDKmDjivEo8JtXoAMI+OQjF/sj86BzaIg0QACLD0c01I7DKlphI+CAj0BYQiCK+IAC+O1tAA=== Pipeline run: https://prefect1.hedwig-workflow-api.niaidqa.net/default/flow-run/4676d77e-9c92-4f4b-9691-be2a0cc23c4d

philipmac commented 1 year ago

Re ran this pipeline, without any modifications, in production. File system issue did not occur. There was one mrc file that was not convertable it appears, this is probably not related to the file system.

No issues exist with this in QA. It should be noted that not all files were run, only 7 of the 9, so this is not a like with like comparison.

philipmac commented 1 year ago

'mrc file /mnt/ai-fas12/RMLEMHedwigProd/Projects/CC/jkovacs/jkovacs-2023-0602-PCPmsg/Cryo-TEM-2023-0602-FolderTest/MSG/J19_272_class_averages.mrc is not 2 dimensional. Contains 50 Z dims.

This is expected behaviour, if non 2D mrcs are attempted to be run within this pipeline.