Closed baxpr closed 1 year ago
Tested this on VUSTP (VUSTP10_dcm2niix), but it doesn't seem to be working.
On personal ACCRE account, installed this branch of dax in venv and did the test the same way I'd normally test an assessor. Created a test slant (slant_usable_test_v0.0.0.yaml), changing the require_usable/need_qc options multiple times, and always get a COMPLETED assessor.
This should basically see that it could run an assessor but ignore until marked usable right? So should it even build? I guess I'm a little confused on that part.
It should build, but not run, if needs_qc is True, require_usable is True, and the scan is set to questionable.
Set your yaml up for that and post it here?
Like I said, this completes no problem; see VUSTP10_dcm2niix that I ran this morning. I'm not sure if there's something that we missed in the processor code. I looked that over and it seems to be right too.
slant_usable_test_v0.0.0.yaml
---
moreauto: true
procname: slant
inputs:
default:
container_path: slant_v1.0.0.simg
xnat:
scans:
- name: scan_t1
types: MJD_3DT1
needs_qc: True
require_usable: True
resources:
- resource: NIFTI
varname: t1_file
fmatch: '*'
fcount: 1
fdest: T1.nii.gz
ftype: FILE
outputs:
- path: FinalPDF/T1_result.pdf
type: FILE
resource: PDF
- path: FinalResult/T1_seg.nii.gz
type: FILE
resource: SEG
- path: FinalVolTxt/T1_label_volumes.txt
type: FILE
resource: STATS
command: >-
singularity exec
--nv --cleanenv --contain
-B $INDIR:/INPUTS
-B $OUTDIR:/OUTPUTS
-B $INDIR:/tmp
-B $INDIR:/home/$USER
{container_path} bash -c 'touch ~/.bashrc && /extra/run_deep_brain_seg.sh'
attrs:
xsitype: proc:genProcData
walltime: "72:00:00"
memory: 16384
ppn: 1
jobtemplate: job_template_gpu.txt
VUSTP.yaml
---
processorlib: /data/mcr/centos7/dax_processors_test_zone
modulelib: /data/mcr/centos7/dax_modules
singularity_imagedir: /data/mcr/centos7/singularity
jobtemplate: /data/mcr/centos7/dax_templates/job_template.txt
resdir: /scratch/duettwe/Spider_Upload_Dir
admin_email: william.e.duett@vumc.org
attrs:
queue_limit: 1000
job_email: william.e.duett@vumc.org
job_email_options: FAIL
xnat_host: https://xnat2.vanderbilt.edu/xnat
skip_lastupdate: Y
yamlprocessors:
- name: slant_usable_test
filepath: slant_usable_test_v0.0.0.yaml
projects:
- project: VUSTP
yamlprocessors: slant_usable_test
That's not v3 yaml - new code only applies to v3.
Duh. Tried this instead - still does the same thing (acapulco_usable_v0.0.0.yaml; same test session)
---
procyamlversion: 3.0.0-dev.0
containers:
- name: ACAPULCOV23
path: acapulco_v23.0.0.sif
source: http://iacl.jhu.edu/~shuo/data/acapulco_023.sif
requirements:
walltime: 0-8
memory: 16G
inputs:
xnat:
scans:
- name: scan_t1
types: MJD_3DT1
needs_qc: True
require_usable: True
resources:
- resource: NIFTI
ftype: FILE
fdest: T1.nii.gz
fmatch: '*.nii.gz'
outputs:
- dir: mni
- dir: parc
- {path: T1_n4_mni_seg_post_volumes.csv, type: FILE, resource: T1_VOLUMES_CSV}
command:
type: singularity_run
args: -i /INPUTS/T1.nii.gz -o /OUTPUTS
container: ACAPULCOV23
description: |
ACAPULCO - Automatic Cerebellum Anatomical Parcellation Using U-Net with Locally Constrained Optimization
https://gitlab.com/shuohan/keras-unet-cerebellum
jobtemplate: job_template_v3.txt
Thanks. Got build logs?
Starting smemwatch
Linux cn1391.vampire 3.10.0-1160.71.1.el7.x86_64 #1 SMP Tue Jun 28 15:37:28 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
Tue Jan 17 10:11:51 CST 2023
/scratch/duettwe/Spider_Upload_Dir/VUSTP-x-VUSTP10-x-VUSTP10_dcm2niix-x-acapulco_usable_v0-x-796aed0b
/tmp/VUSTP-x-VUSTP10-x-VUSTP10_dcm2niix-x-acapulco_usable_v0-x-796aed0b.f8XuGNUU7/INPUTS
/tmp/VUSTP-x-VUSTP10-x-VUSTP10_dcm2niix-x-acapulco_usable_v0-x-796aed0b.f8XuGNUU7/OUTPUTS
/data/mcr/centos7/singularity/acapulco_v23.0.0.sif
https://xnat2.vanderbilt.edu/xnat
daxtest
25
300
Checking that we can download
INFO:smemwatch:starting monitoring cgroup=/slurm/uid_877372/job_48394968/step_batch/task_0
INFO:smemwatch:memory limit is 17121.278515625MB
INFO:smemwatch:observation delay is 50ms
1
Looks good, ready to download
DONE!
curl -D - -s -b JSESSIONID=SESSID "https://xnat2.vanderbilt.edu/xnat/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/scans/201/resources/NIFTI/files/MJD_3DT1.nii.gz" -o /tmp/VUSTP-x-VUSTP10-x-VUSTP10_dcm2niix-x-acapulco_usable_v0-x-796aed0b.f8XuGNUU7/INPUTS/T1.nii.gz | head -n 1 | awk '{print $2}'
result=200
singularity run --contain --cleanenv --home /tmp/VUSTP-x-VUSTP10-x-VUSTP10_dcm2niix-x-acapulco_usable_v0-x-796aed0b.f8XuGNUU7 --bind /tmp/VUSTP-x-VUSTP10-x-VUSTP10_dcm2niix-x-acapulco_usable_v0-x-796aed0b.f8XuGNUU7/INPUTS:/INPUTS --bind /tmp/VUSTP-x-VUSTP10-x-VUSTP10_dcm2niix-x-acapulco_usable_v0-x-796aed0b.f8XuGNUU7/OUTPUTS:/OUTPUTS --bind /tmp/VUSTP-x-VUSTP10-x-VUSTP10_dcm2niix-x-acapulco_usable_v0-x-796aed0b.f8XuGNUU7:/tmp --bind /tmp/VUSTP-x-VUSTP10-x-VUSTP10_dcm2niix-x-acapulco_usable_v0-x-796aed0b.f8XuGNUU7:/dev/shm /data/mcr/centos7/singularity/acapulco_v23.0.0.sif -i /INPUTS/T1.nii.gz -o /OUTPUTS
N4 correction...
MNI registraion...
bad det -1 v -1 u 1
bad det -1 v -1 u 1 new 1
Cerebellum parcellation...
Exception ignored in: <bound method BaseSession.__del__ of <tensorflow.python.client.session.Session object at 0x2b81308cb860>>
Traceback (most recent call last):
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/client/session.py", line 712, in __del__
File "/usr/local/lib/python3.5/dist-packages/tensorflow/python/framework/c_api_util.py", line 31, in __init__
TypeError: 'NoneType' object is not callable
From /OUTPUTS/mni/T1_n4_mni.nii.gz to /OUTPUTS/parc/T1_n4_mni_seg.nii.gz
Post processing...
From /OUTPUTS/parc/T1_n4_mni_seg.nii.gz to /OUTPUTS/parc/T1_n4_mni_seg_post.nii.gz
Transform back to original space...
From /OUTPUTS/parc/T1_n4_mni_seg_post.nii.gz to /OUTPUTS/T1_n4_mni_seg_post_inverse.nii.gz
Calculate volumes of each region...
The voxel size: 1.0
From /OUTPUTS/parc/T1_n4_mni_seg_post.nii.gz to /OUTPUTS/T1_n4_mni_seg_post_volumes.csv
COMPLETE
DONE!
That's the outlog - looking for what dax build
spits out. Not sure if there is useful info there or not
oh, build logs. I can re-build it real quick
(dax_test_usable) [duettwe@gw342 dax_project_settings_test_zone]$ dax build --project VUSTP --sessions VUSTP10_dcm2niix VUSTP.yaml
2023-01-17 11:28:00,122 - INFO - bin - Current Process ID: 23926
2023-01-17 11:28:00,122 - INFO - bin - Current Process Name: dax.bin.build(VUSTP.yaml)
2023-01-17 11:28:00,122 - INFO - bin - loading settings from: VUSTP.yaml
2023-01-17 11:28:00,148 - DEBUG - processors - loading as Processor_v3:/data/mcr/centos7/dax_processors_test_zone/acapulco_usable_v0.0.0.yaml
2023-01-17 11:28:00,167 - INFO - launcher - XNAT CR status: cr=None, self.cr=False
2023-01-17 11:28:00,169 - INFO - bin - running launcher, Start Time: 2023-01-17 11:28:00.169199
2023-01-17 11:28:00,169 - INFO - launcher - -------------- Build --------------
2023-01-17 11:28:00,169 - INFO - launcher - launcher_type = diskq-combined
2023-01-17 11:28:00,169 - INFO - launcher - mod delta = None
2023-01-17 11:28:00,169 - INFO - launcher - Connecting to XNAT at https://xnat2.vanderbilt.edu/xnat
2023-01-17 11:28:00,170 - DEBUG - XnatUtils - _exec:DELETE:/data/JSESSION
2023-01-17 11:28:00,170 - DEBUG - XnatUtils - _exec:GET:/data/JSESSION
2023-01-17 11:28:00,287 - DEBUG - XnatUtils - _exec:GET:/data/JSESSION
2023-01-17 11:28:00,374 - DEBUG - XnatUtils - _exec:GET:/data/search/elements?format=csv
2023-01-17 11:28:00,384 - INFO - launcher - ===== PROJECT: VUSTP =====
2023-01-17 11:28:00,384 - INFO - launcher - * Loading list of sessions from XNAT for project
2023-01-17 11:28:00,384 - DEBUG - XnatUtils - _exec:GET:/REST/projects/VUSTP/experiments?columns=xsiType&format=csv
2023-01-17 11:28:01,732 - DEBUG - XnatUtils - _exec:GET:/REST/projects/VUSTP/experiments?xsiType=xnat:hdsessiondata&columns=ID,subject_label,subject_ID,xsiType,label,xnat:hdsessiondata/meta/last_modified&format=csv
2023-01-17 11:28:01,872 - DEBUG - XnatUtils - _exec:GET:/REST/projects/VUSTP/experiments?xsiType=xnat:ctsessiondata&columns=ID,subject_label,subject_ID,xsiType,label,xnat:ctsessiondata/meta/last_modified&format=csv
2023-01-17 11:28:03,248 - DEBUG - XnatUtils - _exec:GET:/REST/projects/VUSTP/experiments?xsiType=xnat:mrsessiondata&columns=ID,subject_label,subject_ID,xsiType,label,xnat:mrsessiondata/meta/last_modified&format=csv
2023-01-17 11:28:07,557 - DEBUG - XnatUtils - _exec:GET:/data/search/elements?format=csv
2023-01-17 11:28:07,573 - DEBUG - XnatUtils - _exec:GET:/REST/archive/experiments?project=VUSTP&xsiType=proc:genProcData&columns=ID,xsiType,project,proc:genProcData/proctype&format=csv
2023-01-17 11:28:45,312 - DEBUG - XnatUtils - _exec:GET:/data/search/elements?format=csv
2023-01-17 11:28:45,324 - DEBUG - XnatUtils - _exec:GET:/REST/archive/experiments?project=VUSTP&xsiType=fs:fsData&columns=ID,xsiType,project&format=csv
2023-01-17 11:28:47,387 - DEBUG - launcher - ['dtiQA_v6', 'LST_v1', 'intra_sess_reg', 'Seeleyfmripreproc_v1', 'SCFusion_v1', 'RWML_v1', 'VBMQA', 'NDW_VBM_reorient2std_v1', 'fMRI_Preprocess', 'ON_MR_segmentation_vDEV1', 'FS6_v1', 'fMRIQA_v3', 'ASLQA_Rest_v1', 'FSL_First', 'White_Matter_Stamper', 'dtiQA_Multi', 'nonrigid_reg_to_ATLAS', 'MGC_Tractography_v1', 'Multi_Atlas_Fix_v1', 'fMRIQA_v2', 'dtiQA_v3', 'dtiQA_v2', 'cat12_ss2p0_v2', 'Bedpost_v1', 'fMRIQA', 'conncalc-asdr_v1', 'connprep-asdr_v2', 'FreeSurfer', 'TBSS_pre', 'RSFC_CONN_v1', 'ON_CT_segmentation_v2', 'Multi_Atlas', 'Probtrackx2_v1', 'TRACULA_v1']
2023-01-17 11:28:47,388 - DEBUG - launcher - has_new=True
2023-01-17 11:28:47,388 - INFO - launcher - + Subject VUSTP10: loading XML for 1 session(s)...
2023-01-17 11:28:47,392 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix?format=xml
2023-01-17 11:29:08,395 - INFO - launcher - + Session VUSTP10_dcm2niix: building...
2023-01-17 11:29:08,397 - DEBUG - launcher - == Build auto processors ==
2023-01-17 11:29:08,397 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments?format=csv&columns=xsiType,ID,label
2023-01-17 11:29:08,593 - DEBUG - processors_v3 - session is first, including pets
2023-01-17 11:29:08,602 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/assessors?format=csv&columns=ID,label
2023-01-17 11:29:09,887 - DEBUG - XnatUtils - _exec:GET:/data/projects?format=csv&columns=ID
2023-01-17 11:29:09,950 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects?format=csv&columns=ID,label
2023-01-17 11:29:10,088 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments?format=csv&columns=ID,label
2023-01-17 11:29:10,306 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments?format=csv&columns=ID,label
2023-01-17 11:29:10,489 - DEBUG - XnatUtils - _exec:PUT:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/assessors/d03541a0-edff-4c6f-ad38-b185220a31e2?xsiType=proc:genprocdata&ID=d03541a0-edff-4c6f-ad38-b185220a31e2&label=VUSTP-x-VUSTP10-x-VUSTP10_dcm2niix-x-acapulco_usable_v0-x-d03541a0&proc:genprocdata/proctype=acapulco_usable_v0&proc:genprocdata/procversion=0.0.0&proc:genprocdata/inputs={"scan_t1": "/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/scans/201"}&proc:genprocdata/procstatus=NEED_INPUTS&proc:genprocdata/date=2023-01-17
2023-01-17 11:29:13,632 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/assessors?format=csv&columns=ID,label
2023-01-17 11:29:14,864 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments?columns=ID,xnat:mrSessionData/meta/last_modified&format=csv
2023-01-17 11:29:18,199 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments?format=csv&columns=ID,label
2023-01-17 11:29:18,374 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix?format=xml
2023-01-17 11:29:40,894 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/assessors?format=csv&columns=ID,label
2023-01-17 11:29:42,159 - DEBUG - launcher - building task: VUSTP-x-VUSTP10-x-VUSTP10_dcm2niix-x-acapulco_usable_v0-x-d03541a0
2023-01-17 11:29:42,160 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/assessors?format=csv&columns=ID,label
2023-01-17 11:29:43,298 - DEBUG - processors_v3 - checking status of each artefact
2023-01-17 11:29:43,298 - DEBUG - processors_v3 - checking status:scan_t1
2023-01-17 11:29:43,299 - DEBUG - processors_v3 - mapping params to artefact resources
2023-01-17 11:29:43,299 - DEBUG - processors_v3 - mapping:scan_t1-NIFTI-0
2023-01-17 11:29:43,302 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/scans/201/resources/NIFTI/files?format=csv&columns=path,xsiType
2023-01-17 11:29:44,475 - DEBUG - processors_v3 - finished mapping params to artefact resources
2023-01-17 11:29:44,476 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/assessors/d03541a0-edff-4c6f-ad38-b185220a31e2/out/resources?format=csv&columns=xnat_abstractresource_id,label
2023-01-17 11:29:46,459 - INFO - task - writing:/scratch/duettwe/Spider_Upload_Dir/DISKQ/BATCH/VUSTP-x-VUSTP10-x-VUSTP10_dcm2niix-x-acapulco_usable_v0-x-d03541a0.slurm
2023-01-17 11:29:46,463 - DEBUG - task - writing processor spec file
2023-01-17 11:29:46,465 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/assessors?format=csv&columns=xsiType,ID,label
2023-01-17 11:29:47,614 - DEBUG - XnatUtils - _exec:PUT:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/assessors/d03541a0-edff-4c6f-ad38-b185220a31e2?xsiType=proc%3AgenProcData&proc%3Agenprocdata/procstatus=JOB_RUNNING&proc%3Agenprocdata/validation/status=Job%20Pending
2023-01-17 11:29:49,583 - DEBUG - launcher - proc_status=JOB_RUNNING, qc_status=Job Pending
2023-01-17 11:29:49,583 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments?columns=ID,xnat:mrSessionData/meta/last_modified&format=csv
2023-01-17 11:29:52,869 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments?format=csv&columns=ID,label
2023-01-17 11:29:53,048 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix?format=xml
2023-01-17 11:30:15,059 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments?columns=ID,xnat:mrSessionData/meta/last_modified&format=csv
2023-01-17 11:30:18,296 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments?format=csv&columns=ID,label
2023-01-17 11:30:18,448 - DEBUG - launcher - initial timestamp=2023-01-17 11:28:47.388642, final timestamp=2023-01-17 11:30:15.059424
2023-01-17 11:30:18,449 - DEBUG - launcher - uploading session log:/tmp/tmpqnajz8e0/VUSTP10_dcm2niix_build_log-20230117-112908.txt
2023-01-17 11:30:18,449 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/resources/BUILD_LOGS/files?format=csv&columns=path
2023-01-17 11:30:19,590 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/resources?format=csv&columns=xnat_abstractresource_id,label
2023-01-17 11:30:20,678 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/resources?format=csv&columns=xnat_abstractresource_id,label
2023-01-17 11:30:25,057 - DEBUG - XnatUtils - _exec:DELETE:/data/JSESSION
2023-01-17 11:30:25,076 - INFO - bin - finished build, End Time: 2023-01-17 11:30:25.076773
hrmf. Ok, I added some debugging, can you please pull the update and show the build output again?
I'm not seeing any of those? Here's how I'm getting dax:
pip install git+https://github.com/VUIIS/dax.git@baxpr-usable
(dax_test_usable) [duettwe@gw345 dax_project_settings_test_zone]$ dax build --project VUSTP --sessions VUSTP10_dcm2niix VUSTP.yaml
2023-01-17 12:15:58,061 - INFO - bin - Current Process ID: 31165
2023-01-17 12:15:58,061 - INFO - bin - Current Process Name: dax.bin.build(VUSTP.yaml)
2023-01-17 12:15:58,061 - INFO - bin - loading settings from: VUSTP.yaml
2023-01-17 12:15:58,087 - DEBUG - processors - loading as Processor_v3:/data/mcr/centos7/dax_processors_test_zone/acapulco_usable_v0.0.0.yaml
2023-01-17 12:15:58,122 - INFO - launcher - XNAT CR status: cr=None, self.cr=False
2023-01-17 12:15:58,124 - INFO - bin - running launcher, Start Time: 2023-01-17 12:15:58.124512
2023-01-17 12:15:58,124 - INFO - launcher - -------------- Build --------------
2023-01-17 12:15:58,124 - INFO - launcher - launcher_type = diskq-combined
2023-01-17 12:15:58,125 - INFO - launcher - mod delta = None
2023-01-17 12:15:58,125 - INFO - launcher - Connecting to XNAT at https://xnat2.vanderbilt.edu/xnat
2023-01-17 12:15:58,125 - DEBUG - XnatUtils - _exec:DELETE:/data/JSESSION
2023-01-17 12:15:58,126 - DEBUG - XnatUtils - _exec:GET:/data/JSESSION
2023-01-17 12:16:00,252 - DEBUG - XnatUtils - _exec:GET:/data/JSESSION
2023-01-17 12:16:00,343 - DEBUG - XnatUtils - _exec:GET:/data/search/elements?format=csv
2023-01-17 12:16:00,358 - INFO - launcher - ===== PROJECT: VUSTP =====
2023-01-17 12:16:00,358 - INFO - launcher - * Loading list of sessions from XNAT for project
2023-01-17 12:16:00,358 - DEBUG - XnatUtils - _exec:GET:/REST/projects/VUSTP/experiments?columns=xsiType&format=csv
2023-01-17 12:16:01,887 - DEBUG - XnatUtils - _exec:GET:/REST/projects/VUSTP/experiments?xsiType=xnat:hdsessiondata&columns=ID,subject_label,subject_ID,xsiType,label,xnat:hdsessiondata/meta/last_modified&format=csv
2023-01-17 12:16:02,033 - DEBUG - XnatUtils - _exec:GET:/REST/projects/VUSTP/experiments?xsiType=xnat:ctsessiondata&columns=ID,subject_label,subject_ID,xsiType,label,xnat:ctsessiondata/meta/last_modified&format=csv
2023-01-17 12:16:03,429 - DEBUG - XnatUtils - _exec:GET:/REST/projects/VUSTP/experiments?xsiType=xnat:mrsessiondata&columns=ID,subject_label,subject_ID,xsiType,label,xnat:mrsessiondata/meta/last_modified&format=csv
2023-01-17 12:16:08,101 - DEBUG - XnatUtils - _exec:GET:/data/search/elements?format=csv
2023-01-17 12:16:08,117 - DEBUG - XnatUtils - _exec:GET:/REST/archive/experiments?project=VUSTP&xsiType=proc:genProcData&columns=ID,xsiType,project,proc:genProcData/proctype&format=csv
2023-01-17 12:16:45,654 - DEBUG - XnatUtils - _exec:GET:/data/search/elements?format=csv
2023-01-17 12:16:45,671 - DEBUG - XnatUtils - _exec:GET:/REST/archive/experiments?project=VUSTP&xsiType=fs:fsData&columns=ID,xsiType,project&format=csv
2023-01-17 12:16:47,760 - DEBUG - launcher - ['dtiQA_v6', 'FreeSurfer', 'cat12_ss2p0_v2', 'VBMQA', 'fMRI_Preprocess', 'Multi_Atlas_Fix_v1', 'conncalc-asdr_v1', 'RWML_v1', 'MGC_Tractography_v1', 'dtiQA_v3', 'dtiQA_Multi', 'fMRIQA_v3', 'ASLQA_Rest_v1', 'TBSS_pre', 'FS6_v1', 'fMRIQA', 'dtiQA_v2', 'Probtrackx2_v1', 'FSL_First', 'ON_MR_segmentation_vDEV1', 'connprep-asdr_v2', 'Bedpost_v1', 'nonrigid_reg_to_ATLAS', 'fMRIQA_v2', 'intra_sess_reg', 'NDW_VBM_reorient2std_v1', 'TRACULA_v1', 'White_Matter_Stamper', 'LST_v1', 'Seeleyfmripreproc_v1', 'ON_CT_segmentation_v2', 'SCFusion_v1', 'Multi_Atlas', 'RSFC_CONN_v1']
2023-01-17 12:16:47,760 - DEBUG - launcher - has_new=True
2023-01-17 12:16:47,760 - INFO - launcher - + Subject VUSTP10: loading XML for 1 session(s)...
2023-01-17 12:16:47,768 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix?format=xml
2023-01-17 12:17:08,630 - INFO - launcher - + Session VUSTP10_dcm2niix: building...
2023-01-17 12:17:08,631 - DEBUG - launcher - == Build auto processors ==
2023-01-17 12:17:08,632 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments?format=csv&columns=ID,label,xsiType
2023-01-17 12:17:08,837 - DEBUG - processors_v3 - session is first, including pets
2023-01-17 12:17:08,844 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/assessors?format=csv&columns=ID,label
2023-01-17 12:17:10,069 - DEBUG - XnatUtils - _exec:GET:/data/projects?format=csv&columns=ID
2023-01-17 12:17:10,131 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects?format=csv&columns=ID,label
2023-01-17 12:17:10,261 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments?format=csv&columns=ID,label
2023-01-17 12:17:10,416 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments?format=csv&columns=ID,label
2023-01-17 12:17:10,542 - DEBUG - XnatUtils - _exec:PUT:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/assessors/c9b7db3c-5223-4ff2-a838-5ea5ad314226?xsiType=proc:genprocdata&ID=c9b7db3c-5223-4ff2-a838-5ea5ad314226&label=VUSTP-x-VUSTP10-x-VUSTP10_dcm2niix-x-acapulco_usable_v0-x-c9b7db3c&proc:genprocdata/proctype=acapulco_usable_v0&proc:genprocdata/procversion=0.0.0&proc:genprocdata/inputs={"scan_t1": "/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/scans/201"}&proc:genprocdata/procstatus=NEED_INPUTS&proc:genprocdata/date=2023-01-17
2023-01-17 12:17:13,392 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/assessors?format=csv&columns=ID,label
2023-01-17 12:17:14,595 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments?columns=ID,xnat:mrSessionData/meta/last_modified&format=csv
2023-01-17 12:17:17,742 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments?format=csv&columns=ID,label
2023-01-17 12:17:17,947 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix?format=xml
2023-01-17 12:17:40,126 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/assessors?format=csv&columns=ID,label
2023-01-17 12:17:41,311 - DEBUG - launcher - building task: VUSTP-x-VUSTP10-x-VUSTP10_dcm2niix-x-acapulco_usable_v0-x-c9b7db3c
2023-01-17 12:17:41,312 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/assessors?format=csv&columns=ID,label
2023-01-17 12:17:42,872 - DEBUG - processors_v3 - checking status of each artefact
2023-01-17 12:17:42,872 - DEBUG - processors_v3 - checking status:scan_t1
2023-01-17 12:17:42,873 - DEBUG - processors_v3 - mapping params to artefact resources
2023-01-17 12:17:42,874 - DEBUG - processors_v3 - mapping:scan_t1-NIFTI-0
2023-01-17 12:17:42,877 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/scans/201/resources/NIFTI/files?format=csv&columns=path,xsiType
2023-01-17 12:17:44,260 - DEBUG - processors_v3 - finished mapping params to artefact resources
2023-01-17 12:17:44,261 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/assessors/c9b7db3c-5223-4ff2-a838-5ea5ad314226/out/resources?format=csv&columns=label,xnat_abstractresource_id
2023-01-17 12:17:46,283 - INFO - task - writing:/scratch/duettwe/Spider_Upload_Dir/DISKQ/BATCH/VUSTP-x-VUSTP10-x-VUSTP10_dcm2niix-x-acapulco_usable_v0-x-c9b7db3c.slurm
2023-01-17 12:17:46,304 - DEBUG - task - writing processor spec file
2023-01-17 12:17:46,317 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/assessors?format=csv&columns=ID,label,xsiType
2023-01-17 12:17:47,561 - DEBUG - XnatUtils - _exec:PUT:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/assessors/c9b7db3c-5223-4ff2-a838-5ea5ad314226?xsiType=proc%3AgenProcData&proc%3Agenprocdata/procstatus=JOB_RUNNING&proc%3Agenprocdata/validation/status=Job%20Pending
2023-01-17 12:17:49,468 - DEBUG - launcher - proc_status=JOB_RUNNING, qc_status=Job Pending
2023-01-17 12:17:49,468 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments?columns=ID,xnat:mrSessionData/meta/last_modified&format=csv
2023-01-17 12:17:52,594 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments?format=csv&columns=ID,label
2023-01-17 12:17:52,745 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix?format=xml
2023-01-17 12:18:14,884 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments?columns=ID,xnat:mrSessionData/meta/last_modified&format=csv
2023-01-17 12:18:18,306 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments?format=csv&columns=ID,label
2023-01-17 12:18:18,464 - DEBUG - launcher - initial timestamp=2023-01-17 12:16:47.760847, final timestamp=2023-01-17 12:18:14.884480
2023-01-17 12:18:18,465 - DEBUG - launcher - uploading session log:/tmp/tmp2in73czc/VUSTP10_dcm2niix_build_log-20230117-121708.txt
2023-01-17 12:18:18,466 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/resources/BUILD_LOGS/files?format=csv&columns=path
2023-01-17 12:18:19,567 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/resources?format=csv&columns=label,xnat_abstractresource_id
2023-01-17 12:18:20,661 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/resources?format=csv&columns=label,xnat_abstractresource_id
2023-01-17 12:18:25,224 - DEBUG - XnatUtils - _exec:DELETE:/data/JSESSION
2023-01-17 12:18:25,239 - INFO - bin - finished build, End Time: 2023-01-17 12:18:25.239461
(dax_test_usable) [duettwe@gw345 dax_project_settings_test_zone]$ pip install git+https://github.com/VUIIS/dax.git@baxpr-usable
Defaulting to user installation because normal site-packages is not writeable
Collecting git+https://github.com/VUIIS/dax.git@baxpr-usable
Cloning https://github.com/VUIIS/dax.git (to revision baxpr-usable) to /tmp/pip-req-build-1vokadm5
Running command git clone --filter=blob:none --quiet https://github.com/VUIIS/dax.git /tmp/pip-req-build-1vokadm5
Running command git checkout -b baxpr-usable --track origin/baxpr-usable
Switched to a new branch 'baxpr-usable'
Branch 'baxpr-usable' set up to track remote branch 'baxpr-usable' from 'origin'.
Resolved https://github.com/VUIIS/dax.git to commit 569fd7b7ad958008b472373356cc1de246cb3374
Preparing metadata (setup.py) ... done
...
Sorry, I put it in the subject assessor section by mistake. Should be in the right place now I hope
Still not seeing it. Should be between these two lines:
2023-01-17 12:39:09,667 - DEBUG - processors_v3 - checking status:scan_t1
2023-01-17 12:39:09,668 - DEBUG - processors_v3 - mapping params to artefact resources
I wonder if I'm pulling that branch incorrectly, or if that's wrong entirely.
Oh, when using pip to install from github you have to pip uninstall dax
first I think
That fixed it
(dax_test_usable) [duettwe@gw345 dax_project_settings_test_zone]$ dax build --project VUSTP --sessions VUSTP10_dcm2niix VUSTP.yaml
2023-01-17 12:59:54,147 - INFO - bin - Current Process ID: 27590
2023-01-17 12:59:54,147 - INFO - bin - Current Process Name: dax.bin.build(VUSTP.yaml)
2023-01-17 12:59:54,147 - INFO - bin - loading settings from: VUSTP.yaml
2023-01-17 12:59:54,160 - DEBUG - processors - loading as Processor_v3:/data/mcr/centos7/dax_processors_test_zone/acapulco_usable_v0.0.0.yaml
2023-01-17 12:59:54,169 - INFO - launcher - XNAT CR status: cr=None, self.cr=False
2023-01-17 12:59:54,170 - INFO - bin - running launcher, Start Time: 2023-01-17 12:59:54.170468
2023-01-17 12:59:54,170 - INFO - launcher - -------------- Build --------------
2023-01-17 12:59:54,170 - INFO - launcher - launcher_type = diskq-combined
2023-01-17 12:59:54,170 - INFO - launcher - mod delta = None
2023-01-17 12:59:54,171 - INFO - launcher - Connecting to XNAT at https://xnat2.vanderbilt.edu/xnat
2023-01-17 12:59:54,171 - DEBUG - XnatUtils - _exec:DELETE:/data/JSESSION
2023-01-17 12:59:54,171 - DEBUG - XnatUtils - _exec:GET:/data/JSESSION
2023-01-17 12:59:54,299 - DEBUG - XnatUtils - _exec:GET:/data/JSESSION
2023-01-17 12:59:54,390 - DEBUG - XnatUtils - _exec:GET:/data/search/elements?format=csv
2023-01-17 12:59:54,406 - INFO - launcher - ===== PROJECT: VUSTP =====
2023-01-17 12:59:54,407 - INFO - launcher - * Loading list of sessions from XNAT for project
2023-01-17 12:59:54,407 - DEBUG - XnatUtils - _exec:GET:/REST/projects/VUSTP/experiments?columns=xsiType&format=csv
2023-01-17 12:59:55,846 - DEBUG - XnatUtils - _exec:GET:/REST/projects/VUSTP/experiments?xsiType=xnat:hdsessiondata&columns=ID,subject_label,subject_ID,xsiType,label,xnat:hdsessiondata/meta/last_modified&format=csv
2023-01-17 12:59:55,951 - DEBUG - XnatUtils - _exec:GET:/REST/projects/VUSTP/experiments?xsiType=xnat:ctsessiondata&columns=ID,subject_label,subject_ID,xsiType,label,xnat:ctsessiondata/meta/last_modified&format=csv
2023-01-17 12:59:57,240 - DEBUG - XnatUtils - _exec:GET:/REST/projects/VUSTP/experiments?xsiType=xnat:mrsessiondata&columns=ID,subject_label,subject_ID,xsiType,label,xnat:mrsessiondata/meta/last_modified&format=csv
2023-01-17 13:00:01,557 - DEBUG - XnatUtils - _exec:GET:/data/search/elements?format=csv
2023-01-17 13:00:01,571 - DEBUG - XnatUtils - _exec:GET:/REST/archive/experiments?project=VUSTP&xsiType=proc:genProcData&columns=ID,xsiType,project,proc:genProcData/proctype&format=csv
2023-01-17 13:00:37,298 - DEBUG - XnatUtils - _exec:GET:/data/search/elements?format=csv
2023-01-17 13:00:37,315 - DEBUG - XnatUtils - _exec:GET:/REST/archive/experiments?project=VUSTP&xsiType=fs:fsData&columns=ID,xsiType,project&format=csv
2023-01-17 13:00:39,205 - DEBUG - launcher - ['fMRIQA_v2', 'RSFC_CONN_v1', 'Probtrackx2_v1', 'dtiQA_Multi', 'FreeSurfer', 'Bedpost_v1', 'VBMQA', 'NDW_VBM_reorient2std_v1', 'dtiQA_v3', 'FSL_First', 'SCFusion_v1', 'fMRIQA', 'Multi_Atlas', 'dtiQA_v6', 'conncalc-asdr_v1', 'RWML_v1', 'ON_MR_segmentation_vDEV1', 'cat12_ss2p0_v2', 'ASLQA_Rest_v1', 'fMRIQA_v3', 'dtiQA_v2', 'fMRI_Preprocess', 'TRACULA_v1', 'LST_v1', 'ON_CT_segmentation_v2', 'MGC_Tractography_v1', 'nonrigid_reg_to_ATLAS', 'White_Matter_Stamper', 'Seeleyfmripreproc_v1', 'TBSS_pre', 'connprep-asdr_v2', 'Multi_Atlas_Fix_v1', 'FS6_v1', 'intra_sess_reg']
2023-01-17 13:00:39,206 - DEBUG - launcher - has_new=True
2023-01-17 13:00:39,206 - INFO - launcher - + Subject VUSTP10: loading XML for 1 session(s)...
2023-01-17 13:00:39,211 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix?format=xml
2023-01-17 13:00:59,810 - INFO - launcher - + Session VUSTP10_dcm2niix: building...
2023-01-17 13:00:59,811 - DEBUG - launcher - == Build auto processors ==
2023-01-17 13:00:59,811 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments?format=csv&columns=xsiType,ID,label
2023-01-17 13:00:59,979 - DEBUG - processors_v3 - session is first, including pets
2023-01-17 13:00:59,983 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/assessors?format=csv&columns=ID,label
2023-01-17 13:01:01,143 - DEBUG - XnatUtils - _exec:GET:/data/projects?format=csv&columns=ID
2023-01-17 13:01:01,195 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects?format=csv&columns=ID,label
2023-01-17 13:01:01,313 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments?format=csv&columns=ID,label
2023-01-17 13:01:01,447 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments?format=csv&columns=ID,label
2023-01-17 13:01:01,585 - DEBUG - XnatUtils - _exec:PUT:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/assessors/c94b484f-6c8c-4c23-b28f-754194f75dd0?xsiType=proc:genprocdata&ID=c94b484f-6c8c-4c23-b28f-754194f75dd0&label=VUSTP-x-VUSTP10-x-VUSTP10_dcm2niix-x-acapulco_usable_v0-x-c94b484f&proc:genprocdata/proctype=acapulco_usable_v0&proc:genprocdata/procversion=0.0.0&proc:genprocdata/inputs={"scan_t1": "/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/scans/201"}&proc:genprocdata/procstatus=NEED_INPUTS&proc:genprocdata/date=2023-01-17
2023-01-17 13:01:04,443 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/assessors?format=csv&columns=ID,label
2023-01-17 13:01:05,677 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments?columns=ID,xnat:mrSessionData/meta/last_modified&format=csv
2023-01-17 13:01:08,737 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments?format=csv&columns=ID,label
2023-01-17 13:01:08,894 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix?format=xml
2023-01-17 13:01:31,957 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/assessors?format=csv&columns=ID,label
2023-01-17 13:01:33,080 - DEBUG - launcher - building task: VUSTP-x-VUSTP10-x-VUSTP10_dcm2niix-x-acapulco_usable_v0-x-c94b484f
2023-01-17 13:01:33,081 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/assessors?format=csv&columns=ID,label
2023-01-17 13:01:34,184 - DEBUG - processors_v3 - checking status of each artefact
2023-01-17 13:01:34,184 - DEBUG - processors_v3 - checking status:scan_t1
2023-01-17 13:01:34,185 - DEBUG - processors_v3 - Scan status is questionable for:scan_t1
2023-01-17 13:01:34,185 - DEBUG - processors_v3 - Scan require_usable is True for:scan_t1
2023-01-17 13:01:34,185 - DEBUG - processors_v3 - Triggered not usable for:scan_t1
2023-01-17 13:01:34,186 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/assessors?format=csv&columns=xsiType,ID,label
2023-01-17 13:01:35,388 - DEBUG - XnatUtils - _exec:PUT:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/assessors/c94b484f-6c8c-4c23-b28f-754194f75dd0?xsiType=proc%3AgenProcData&proc%3Agenprocdata/procstatus=NEED_INPUTS&proc%3Agenprocdata/validation/status=scan_t1%3A%20Scan%20not%20marked%20usable
2023-01-17 13:01:37,193 - DEBUG - launcher - proc_status=NEED_INPUTS, qc_status=scan_t1: Scan not marked usable
2023-01-17 13:01:37,193 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments?columns=ID,xnat:mrSessionData/meta/last_modified&format=csv
2023-01-17 13:01:40,431 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments?format=csv&columns=ID,label
2023-01-17 13:01:40,648 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix?format=xml
2023-01-17 13:02:03,699 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments?columns=ID,xnat:mrSessionData/meta/last_modified&format=csv
2023-01-17 13:02:07,057 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments?format=csv&columns=ID,label
2023-01-17 13:02:07,223 - DEBUG - launcher - initial timestamp=2023-01-17 13:00:39.206570, final timestamp=2023-01-17 13:02:03.699052
2023-01-17 13:02:07,224 - DEBUG - launcher - uploading session log:/tmp/tmpy3lnxlhh/VUSTP10_dcm2niix_build_log-20230117-130059.txt
2023-01-17 13:02:07,225 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/resources/BUILD_LOGS/files?format=csv&columns=path
2023-01-17 13:02:08,410 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/resources?format=csv&columns=label,xnat_abstractresource_id
2023-01-17 13:02:09,710 - DEBUG - XnatUtils - _exec:GET:/data/projects/VUSTP/subjects/VUSTP10/experiments/VUSTP10_dcm2niix/resources?format=csv&columns=label,xnat_abstractresource_id
2023-01-17 13:02:14,413 - DEBUG - XnatUtils - _exec:DELETE:/data/JSESSION
2023-01-17 13:02:14,432 - INFO - bin - finished build, End Time: 2023-01-17 13:02:14.432054
Sweet. Please mark scan usable and rebuild, see if that part works. I have updated code but only to remove prints
Sweet. Please mark scan usable and rebuild, see if that part works. I have updated code but only to remove prints
This completed on the test session.
For processors v3