PennLINC / xcpEngine

Official public repository for the XCP Engine. This tool is deprecated in favor of XCP-D and ASLPrep.
MIT License
66 stars 42 forks source link

issue at confound2/regress #220

Closed cpdavis closed 4 years ago

cpdavis commented 5 years ago

Hi there,

I'm running into an issue at the confound2/regress stage (probably multiple issues) running the 36p resting state functional connectivity pipeline on preprocessed fmriprep data. I have a sense it might be a binding issue but multiple attempts at solutions have failed. Any insight would be appreciated.

Cohort File

id0,img,anat
sub-1017SP,/scratch/cpd15002/SPLATS_full/results/fmriprep/sub-1017SP/func/sub-1017SP_task-rest_run-01_bold_space-T1w_preproc.nii.gz,/scratch/cpd15002/SPLATS_full/results/fmriprep/sub-1017SP/anat/

Design File

#!/usr/bin/env bash

###################################################################
#  ⊗  ⊗  ⊗  ⊗  ⊗  ⊗  ⊗  ⊗  ⊗  ⊗  ⊗  ⊗  ⊗  ⊗  ⊗  ⊗  ⊗  ⊗  ⊗  ⊗  ⊗  #
###################################################################

###################################################################
# This design file stores the values of all variables required to
# execute a complete neuroimage processing pipeline. You may
# execute the analysis specified in this design file by calling
# (in any v4 or higher bash terminal):
#
# xcpEngine -d <design> -c <cohort> -o <output> <options>
#
# Variables fall into five general categories:
# * ANALYSIS VARIABLES are used at all stages of this analysis.
# * PIPELINE specifies the modules that comprise the analysis.
# * MODULE VARIABLES are used during one stage of the analysis.
#                  These are typically array variables with array
#                  indices equal to the index of the module that
#                  calls them.
# * OUTPUT VARIABLES may be used at all stages of the analysis.
#                  These are typically array variables with array
#                  indices equal to the value of the primary
#                  subject identifier. They will appear only in
#                  localised design files.
###################################################################

###################################################################
# ANALYSIS VARIABLES
###################################################################

analysis=fc_$(whoami)
design=/scratch/cpd15002/SPLATS_full/results/fc-36p.dsn
sequence=fc-rest
standard=MNI%2x2x2

###################################################################
# PIPELINE
###################################################################

pipeline=prestats,confound2,regress,fcon,reho,alff,roiquant,seed,norm,qcfc

###################################################################
# 1 PRESTATS
###################################################################

prestats_rerun[1]=0
prestats_cleanup[1]=1
prestats_process[1]=FMP

###################################################################
# 2 CONFOUND2
###################################################################

confound2_rps[2]=1
confound2_rms[2]=0
confound2_wm[2]=0
confound2_csf[2]=0
confound2_gsr[2]=1
confound2_acompcor[2]=0
confound2_tcompcor[2]=0
confound2_aroma[2]=0
confound2_past[2]=0
confound2_dx[2]=1
confound2_sq[2]=2
confound2_custom[2]=
confound2_censor[2]=0
confound2_censor_contig[2]=0
confound2_framewise[2]=fds:0.25,dv:2
confound2_rerun[2]=0
confound2_cleanup[2]=1

###################################################################
# 3  REGRESS
###################################################################

regress_tmpf[3]=butterworth
regress_hipass[3]=0.01
regress_lopass[3]=0.08
regress_tmpf_order[3]=1
regress_tmpf_pass[3]=2
regress_tmpf_ripple[3]=0.5
regress_tmpf_ripple2[3]=20
regress_dmdt[3]=2
regress_1ddt[3]=1
regress_smo[3]=6
regress_sptf[3]=susan
regress_usan[3]=default
regress_usan_space[3]=
regress_rerun[3]=0
regress_cleanup[3]=1
regress_process[3]=TMP-REG

###################################################################
# 4 FCON
###################################################################

fcon_atlas[4]=all
fcon_metric[4]=corrcoef
fcon_thr[4]=N
fcon_pad[4]=FALSE
fcon_rerun[4]=0
fcon_cleanup[4]=1

###################################################################
# 5 REHO
###################################################################

reho_nhood[5]=vertices
reho_roikw[5]=0 # does nothing at the moment
reho_sptf[5]=susan
reho_smo[5]=6
reho_rerun[5]=0
reho_cleanup[5]=1

###################################################################
# 6 ALFF
###################################################################

alff_hipass[6]=0.01
alff_lopass[6]=0.08
alff_sptf[6]=susan
alff_smo[6]=6
alff_rerun[6]=0
alff_cleanup[6]=1

###################################################################
# 7 ROIQUANT
###################################################################

roiquant_atlas[7]=all
roiquant_globals[7]=1
roiquant_vol[7]=0
roiquant_rerun[7]=0
roiquant_cleanup[7]=1

###################################################################
# 8 SEED
###################################################################

seed_names[8]=RTT#RFG$RPU#LTT$LFG#LPU
seed_points[8]=42,-35,13#28,22,-2#25,4,11#-42,-35,13#-28,22,-2#-25,4,11

###################################################################
# 9 NORM
###################################################################
norm_primary[9]=1
norm_rerun[9]=0
norm_cleanup[9]=1

##################################################################
# 10 QCFC
###################################################################
qcfc_atlas[10]=power264
qcfc_sig[10]=fdr
qcfc_rerun[10]=0
qcfc_cleanup[10]=1

Error Message

/xcpEngine/xcpEngine: line 12: activate: No such file or directory

Current processing step:
@1 Localising subject metadata...
····································································
· @1.1 [Parsing subject identifiers]
· @1.1a [Creating output directory]
· @1.1b [/scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP]
· @1.2 [Initialising space mapping]
· @1.3 [Initialising derivative maps]
· @1.4 [Initialising atlas system]
· @1.5 Ingress
/xcpEngine/core/functions/import_metadata: line 16: ${2}: ambiguous redirect
/xcpEngine/core/functions/import_metadata: line 16: ${2}: ambiguous redirect
· @1.5.1 [Native space: sub-1017SP_fc-rest]
· @1.5.2a [Standard space: MNI]
· @1.5.3a [Anatomical space: sub-1017SP_anatomical]
· @1.5 [Priming analytic audit]
· @1.6 [Priming quality assessment]

Current processing step:
@2 Localising image
····································································
· @2.1 [Verifying that images are present]
· @2.2 [Conforming and localising images]

Current processing step:
@3 Localising design
····································································
· @3.1 [Writing localised design]
· @3.2 [Evaluating subject variables]

                             -   -   -
>> rln /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/sub-1017SP.nii.gz /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP~TEMP~.nii.gz
                             -   -   -
>> 8-6-1
                             -   -   -
>> 8-1

Current processing step:
@0 Ensure matching orientation
····································································
· @0.1a Input: /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP~TEMP~.nii.gz
· @0.1b Template: /xcpEngine/space/MNI/MNI-2x2x2.nii.gz
· @0.1c Output root:
· @0.1d checking the orientation of img and template
                             -   -   -
>> 3dinfo -orient /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP~TEMP~.nii.gz
                             -   -   -
>> 3dinfo -orient /xcpEngine/space/MNI/MNI-2x2x2.nii.gz
· @0.1e img and template orientation are not the same
· @0.1f make it: LPI -> RPI
                             -   -   -
>> 3dresample -orient RPI -inset /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP~TEMP~.nii.gz -prefix /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP~TEMP~_RPI.nii.gz
                             -   -   -
>> immv /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP~TEMP~_RPI.nii.gz /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP~TEMP~.nii.gz
· @0.1 

Current processing step:
@ getting data from fmriprep directory
····································································
                             -   -   -
>> immv /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP~TEMP~ /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP~TEMP~_FMP

                             -   -   -
>> cp /scratch/cpd15002/SPLATS_full/results/fmriprep/sub-1017SP/func/sub-1017SP_task-rest_run-01_desc-confounds_regressors.tsv /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP_fmriconf.tsv
cp: cannot stat '/scratch/cpd15002/SPLATS_full/results/fmriprep/sub-1017SP/func/sub-1017SP_task-rest_run-01_desc-confounds_regressors.tsv': No such file or directory
                             -   -   -
>> 3dresample -orient RPI -inset /scratch/cpd15002/SPLATS_full/results/fmriprep/sub-1017SP/func/sub-1017SP_task-rest_run-01_bold_boldref.nii.gz -prefix /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP_referenceVolume.nii.gz -overwrite
                             -   -   -
>> 3dresample -orient RPI -inset /scratch/cpd15002/SPLATS_full/results/fmriprep/sub-1017SP/func/sub-1017SP_task-rest_run-01_bold_desc-brain_mask.nii.gz -prefix sub-1017SP_imgmask.nii.gz -overwrite
                             -   -   -
>> 3dresample -master /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP_referenceVolume.nii.gz -inset -prefix /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP_structmask.nii.gz -overwrite
                             -   -   -
>> fslmaths sub-1017SP_imgmask.nii.gz -mul /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP_structmask.nii.gz /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP_mask.nii.gz
Cannot open volume sub-1017SP_imgmask for reading!
rm: cannot remove 'sub-1017SP_imgmask.nii.gz': No such file or directory
                             -   -   -
>> 3dresample -master /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP_referenceVolume.nii.gz -inset -prefix /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP_segmentation.nii.gz -overwrite
                             -   -   -
>> 3dresample -master /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP_referenceVolume.nii.gz -inset -prefix /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP_struct.nii.gz -overwrite
                             -   -   -
>> fslmaths /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP_mask.nii.gz -mul /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP_referenceVolume.nii.gz /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP_referenceVolumeBrain.nii.gz
Cannot open volume /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP_mask for reading!
                             -   -   -
>> fslmaths /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP_mask.nii.gz -mul /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP_struct.nii.gz /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP_structbrain.nii.gz
Cannot open volume /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP_mask for reading!
                             -   -   -
>> rm -rf /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP_structmask.nii.gz
· @ generate new /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/sub-1017SP_spaces.json with spaceMetadata
· @ Quality assessment
                             -   -   -
>> ${XCPEDIR}/utils/maskOverlap.R -m /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP_segmentation.nii.gz -r /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP_referenceVolumeBrain.nii.gz
Error in readNifti(mask1path) : 
  Failed to read image from path /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP_segmentation.nii.gz
Calls: readNifti -> .Call
In addition: Warning message:
In readNifti(mask1path) :
  nifti_image_read: failed to find header file for '/scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP_segmentation.nii.gz'
Execution halted
· @0.2 
                             -   -   -
>> imcp /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP~TEMP~_FMP.nii.gz /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP_preprocessed.nii.gz
                             -   -   -
>> fslval /scratch/cpd15002/SPLATS_full/results/fmriprep/sub-1017SP/func/sub-1017SP_task-rest_run-01_bold_space-T1w_preproc.nii.gz pixdim4
                             -   -   -
>> ${XCPEDIR}/utils/addTR.py -i /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP_preprocessed.nii.gz -o /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP_preprocessed.nii.gz -t 1.000000
                             -   -   -
>> 3dresample -orient RPI -inset /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP_preprocessed.nii.gz -prefix /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP_preprocessed.nii.gz -overwrite
                             -   -   -
>> rln /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/prestats/sub-1017SP_preprocessed.nii.gz /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/sub-1017SP.nii.gz
                             -   -   -
>> 7-6-1
                             -   -   -
>> 7-1
                             -   -   -
>> 0.25*1.000000
                             -   -   -
>> mkdir -p /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/mc

Current processing step:
@1 Generating confound matrix
····································································
· @1.1 Generating temporal mask
                             -   -   -
>> ${XCPEDIR}/utils/generate_confmat.R -i -j stdVARS -o /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/mc/sub-1017SP_dvars-std.1D
Error in parse_args(OptionParser(option_list = option_list)) : 
  Error in getopt(spec = spec, opt = args) : flag "i" requires an argument
Execution halted
                             -   -   -
>> ${XCPEDIR}/utils/generate_confmat.R -i -j rps -o /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/mc/sub-1017SP_realignment.1D
Error in parse_args(OptionParser(option_list = option_list)) : 
  Error in getopt(spec = spec, opt = args) : flag "i" requires an argument
Execution halted
                             -   -   -
>> ${XCPEDIR}/utils/generate_confmat.R -i -j fd -o /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/mc/sub-1017SP_relRMS.1D
Error in parse_args(OptionParser(option_list = option_list)) : 
  Error in getopt(spec = spec, opt = args) : flag "i" requires an argument
Execution halted
· @1.1.1 [Computing framewise displacement]
                             -   -   -
>> ${XCPEDIR}/utils/fd.R -r /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/mc/sub-1017SP_realignment.1D -o /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/mc/sub-1017SP_fd.1D
Error in file(file, "rt") : cannot open the connection
Calls: unname -> as.matrix -> read.table -> file
In addition: Warning message:
In file(file, "rt") :
  cannot open file '/scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/mc/sub-1017SP_realignment.1D': No such file or directory
Execution halted
· @1.1.2 [Computing DVARS]
                             -   -   -
>> ${XCPEDIR}/utils/dvars -i /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/sub-1017SP.nii.gz -o /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/mc/sub-1017SP_dvars -s /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP~TEMP~
                             -   -   -
>> fslmaths /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/sub-1017SP.nii.gz -Tmean /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP~TEMP~-dvars-meanIntensity.nii.gz
                             -   -   -
>> bet /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP~TEMP~-dvars-meanIntensity.nii.gz /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP~TEMP~-dvars-meanIntensityBrain.nii.gz
                             -   -   -
>> fslmaths /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/sub-1017SP.nii.gz -Tperc 25 /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP~TEMP~-dvars-lowerQuartile.nii.gz
                             -   -   -
>> fslmaths /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/sub-1017SP.nii.gz -Tperc 75 /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP~TEMP~-dvars-upperQuartile.nii.gz
                             -   -   -
>> fslmaths /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP~TEMP~-dvars-upperQuartile.nii.gz -sub /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP~TEMP~-dvars-lowerQuartile.nii.gz -div 1.34897950039 /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP~TEMP~-dvars-temporalSD.nii.gz
                             -   -   -
>> fslmaths /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/sub-1017SP.nii.gz -sub /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP~TEMP~-dvars-meanIntensity.nii.gz -Tar1 /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP~TEMP~-dvars-temporalAR.nii.gz
                             -   -   -
>> fslmaths /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP~TEMP~-dvars-temporalAR.nii.gz -mul -1 -add 1 -mul 2 -sqrt -mul /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP~TEMP~-dvars-temporalSD.nii.gz /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP~TEMP~-dvars-predictedSD.nii.gz
                             -   -   -
>> fslstats /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP~TEMP~-dvars-predictedSD.nii.gz -k /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP~TEMP~-dvars-meanIntensityBrain.nii.gz -M
                             -   -   -
>> fslnvols /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/sub-1017SP.nii.gz
                             -   -   -
>> fslroi /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/sub-1017SP.nii.gz /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP~TEMP~-dvars-t-1.nii.gz 0 449
                             -   -   -
>> fslroi /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/sub-1017SP.nii.gz /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP~TEMP~-dvars-t.nii.gz 1 450
                             -   -   -
>> fslmaths /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP~TEMP~-dvars-t.nii.gz -sub /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP~TEMP~-dvars-t-1.nii.gz -sqr /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP~TEMP~-dvars-tdiff-sq.nii.gz
                             -   -   -
>> fslmaths /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP~TEMP~-dvars-t.nii.gz -sub /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP~TEMP~-dvars-t-1.nii.gz -div /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP~TEMP~-dvars-predictedSD.nii.gz -sqr /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP~TEMP~-dvars-tdiff-vox-std.nii.gz
                             -   -   -
>> fslstats -t /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP~TEMP~-dvars-tdiff-sq.nii.gz -k /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP~TEMP~-dvars-meanIntensityBrain.nii.gz -M
                             -   -   -
>> rm -f /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/mc/sub-1017SP_dvars-raw.1D
                             -   -   -
>> rm -f /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/mc/sub-1017SP_dvars-std.1D
                             -   -   -
>> rm -f /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/mc/sub-1017SP_dvars-vox.1D
                             -   -   -
>> fslstats -t /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP~TEMP~-dvars-tdiff-vox-std.nii.gz -k /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP~TEMP~-dvars-meanIntensityBrain.nii.gz -M
                             -   -   -
>> ${XCPEDIR}/utils/1dTool.R -i /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/mc/sub-1017SP_dvars-std.1D -o mean -f /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/mc/sub-1017SP_dvars-mean.txt
                             -   -   -
>> rm -f /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/mc/sub-1017SP_spatial_sd.1D /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/mc/sub-1017SP_ts_quality_index.1D /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/mc/sub-1017SP_ts_outliers.1D
                             -   -   -
>> fslstats -t /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/sub-1017SP.nii.gz -S
                             -   -   -
>> 3dTqual -automask /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/sub-1017SP.nii.gz
                             -   -   -
>> 3dToutcount -automask /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/sub-1017SP.nii.gz
                             -   -   -
>> ${XCPEDIR}/utils/featureCorrelation.R -i /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/mc/sub-1017SP_dvars-std.1D,/scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/mc/sub-1017SP_relRMS.1D
· @1.1.3 [Selecting quality criteria]
                             -   -   -
>> rm -f /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/sub-1017SP-nFlags.1D
ERROR: ld.so: object 'libcr_run.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
· @1.1.4 [Quality criterion: fd < .25000000]
                             -   -   -
>> ${XCPEDIR}/utils/tmask.R -s /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/mc/sub-1017SP_fd.1D -t .25000000 -o /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP~TEMP~_-fdMask.1D
Error in file(file, "rt") : cannot open the connection
Calls: unname -> as.matrix -> read.table -> file
In addition: Warning message:
In file(file, "rt") :
  cannot open file '/scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/mc/sub-1017SP_fd.1D': No such file or directory
Execution halted
/xcpEngine/core/functions/temporal_mask: line 146: /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP~TEMP~_-fdMask.1D: No such file or directory
                             -   -   -
>> 0/0
ERROR: ld.so: object 'libcr_run.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
Runtime error (func=(main), adr=10): Divide by zero
· @1.1.4 [Quality criterion: dvars < 2]
                             -   -   -
>> ${XCPEDIR}/utils/tmask.R -s /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/mc/sub-1017SP_dvars-std.1D -t 2 -o /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP~TEMP~_-dvMask.1D
                             -   -   -
>> 0/450
· @1.1.5 [Applying framewise threshold to time series]
                             -   -   -
>> ${XCPEDIR}/utils/tmask.R -s /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/sub-1017SP-nFlags.1D -t 0.5 -o /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/mc/sub-1017SP_tmask.1D -m 0
· @1.1.6 [Evaluating data quality]
· @1.2 relative maximum motion
                             -   -   -
>> ${XCPEDIR}/utils/1dTool.R -i /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/mc/sub-1017SP_relRMS.1D -o max -f /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/mc/sub-1017SP_relMaxRMS.txt
Error in file(file, "rt") : cannot open the connection
Calls: read.table -> file
In addition: Warning message:
In file(file, "rt") :
  cannot open file '/scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/mc/sub-1017SP_relRMS.1D': No such file or directory
Execution halted
· @1.3 relative mean motion
                             -   -   -
>> ${XCPEDIR}/utils/1dTool.R -i /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/mc/sub-1017SP_relRMS.1D -o mean -f /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/mc/sub-1017SP_relMeanRMS.txt
Error in file(file, "rt") : cannot open the connection
Calls: read.table -> file
In addition: Warning message:
In file(file, "rt") :
  cannot open file '/scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/mc/sub-1017SP_relRMS.1D': No such file or directory
Execution halted
· @1.2 Including realignment parameters
                             -   -   -
>> ${XCPEDIR}/utils/mbind.R -x null -y /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/mc/sub-1017SP_realignment.1D -o /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP_confmat.1D
Error in file(file, "rt") : cannot open the connection
Calls: unname -> as.matrix -> read.table -> file
In addition: Warning message:
In file(file, "rt") :
  cannot open file '/scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/mc/sub-1017SP_realignment.1D': No such file or directory
Execution halted
· @1.7 Including gsr
                             -   -   -
>> ${XCPEDIR}/utils/generate_confmat.R -i -j gsr -o /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP_gsr.1D

Error in parse_args(OptionParser(option_list = option_list)) : 
  Error in getopt(spec = spec, opt = args) : flag "i" requires an argument
Execution halted
                             -   -   -
>> ${XCPEDIR}/utils/mbind.R -x /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP_confmat.1D -y /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP_gsr.1D -o /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP_confmat.1D

Error in file(file, "rt") : cannot open the connection
Calls: unname -> as.matrix -> read.table -> file
In addition: Warning message:
In file(file, "rt") :
  cannot open file '/scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP_confmat.1D': No such file or directory
Execution halted
· @1.10 [Including 1 derivative(s)]
                             -   -   -
>> ${XCPEDIR}/utils/mbind.R -x /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP_confmat.1D -y OPdx1 -o /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP_confmat.1D
Error in file(file, "rt") : cannot open the connection
Calls: unname -> as.matrix -> read.table -> file
In addition: Warning message:
In file(file, "rt") :
  cannot open file '/scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP_confmat.1D': No such file or directory
Execution halted
· @1.11 [Including 2 power(s)]
                             -   -   -
>> ${XCPEDIR}/utils/mbind.R -x /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP_confmat.1D -y OPpower2 -o /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP_confmat.1D
Error in file(file, "rt") : cannot open the connection
Calls: unname -> as.matrix -> read.table -> file
In addition: Warning message:
In file(file, "rt") :
  cannot open file '/scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP_confmat.1D': No such file or directory
Execution halted
                             -   -   -
>> fslnvols /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/sub-1017SP.nii.gz

Current processing step:
@2 Validating confound model
····································································
/xcpEngine/modules/confound2/confound2.mod: line 482: /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP_confmat.1D: No such file or directory
                             -   -   -
>> rm -f /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/confound2/sub-1017SP_modelParameterCount.txt
· @2.1a 

                             -   -   -
>> rln /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/sub-1017SP.nii.gz /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/regress/sub-1017SP~TEMP~.nii.gz
                             -   -   -
>> 8-6-1
ERROR: ld.so: object 'libcr_run.so' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
                             -   -   -
>> 8-1

· @0.1 

Current processing step:
@2 Temporally filtering image and confounds
····································································

· @2.2 
· @2.5 
· @2.8 
· @2.12a [butterworth filter]
· @2.12b [High pass frequency: 0.01]
· @2.12c [Low pass frequency: 0.08]

                             -   -   -
>> ${XCPEDIR}/utils/tfilter -i /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/regress/sub-1017SP~TEMP~.nii.gz -o /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/regress/sub-1017SP~TEMP~_TMP.nii.gz -a 1.000000 -f butterworth -h 0.01 -l 0.08 -r 1 -d 2 -1

                             -   -   -
>> remove_ext /scratch/cpd15002/SPLATS_full/results/xcp_output/sub-1017SP/regress/sub-1017SP~TEMP~_TMP.nii.gz

/xcpEngine/utils/tfilter: option requires an argument -- 1

Runtime Information

Singularity on HPC

module load singularity/3.1
SIMG=/scratch/cpd15002/SPLATS_full/applications/xcpEngine.simg
DATA_ROOT=/scratch/cpd15002/SPLATS_full/results

singularity run -B ${DATA_ROOT}:${HOME}/results  \
   ${SIMG} \
   -d ${HOME}/results/fc-36p.dsn \
   -c ${HOME}/results/cohort_test.csv  \
   -o ${HOME}/results/xcp_output \
   -t 2

Sorry if this is naive!

a3sha2 commented 5 years ago

you have to include -r ${HOME}/results like :

singularity run -B ${DATA_ROOT}:${HOME}/results \ \ ${SIMG} \ \ -d ${HOME}/results/fc-36p.dsn \ \ -c ${HOME}/results/cohort_test.csv \ \ -o ${HOME}/results/xcp_output \ \ -t 2 \ -r ${HOME}/results

NB; pls change prestats_rerun[1]=0 to prestats_rerun[1]=1

cpdavis commented 5 years ago

thanks for your quick reply, but I still seem to be getting the same error. is there any other info I can provide to better diagnose the issue?

in case it helps, here is a subject tree under ./results/fmriprep

|-- sub-1017SP
|   |-- anat
|   |   |-- sub-1017SP_T1w_brainmask.nii.gz
|   |   |-- sub-1017SP_T1w_class-CSF_probtissue.nii.gz
|   |   |-- sub-1017SP_T1w_class-GM_probtissue.nii.gz
|   |   |-- sub-1017SP_T1w_class-WM_probtissue.nii.gz
|   |   |-- sub-1017SP_T1w_dtissue.nii.gz
|   |   |-- sub-1017SP_T1w_inflated.L.surf.gii
|   |   |-- sub-1017SP_T1w_inflated.R.surf.gii
|   |   |-- sub-1017SP_T1w_label-aparcaseg_roi.nii.gz
|   |   |-- sub-1017SP_T1w_label-aseg_roi.nii.gz
|   |   |-- sub-1017SP_T1w_midthickness.L.surf.gii
|   |   |-- sub-1017SP_T1w_midthickness.R.surf.gii
|   |   |-- sub-1017SP_T1w_pial.L.surf.gii
|   |   |-- sub-1017SP_T1w_pial.R.surf.gii
|   |   |-- sub-1017SP_T1w_preproc.nii.gz
|   |   |-- sub-1017SP_T1w_smoothwm.L.surf.gii
|   |   |-- sub-1017SP_T1w_smoothwm.R.surf.gii
|   |   |-- sub-1017SP_T1w_space-MNI152NLin2009cAsym_brainmask.nii.gz
|   |   |-- sub-1017SP_T1w_space-MNI152NLin2009cAsym_class-CSF_probtissue.nii.gz
|   |   |-- sub-1017SP_T1w_space-MNI152NLin2009cAsym_class-GM_probtissue.nii.gz
|   |   |-- sub-1017SP_T1w_space-MNI152NLin2009cAsym_class-WM_probtissue.nii.gz
|   |   |-- sub-1017SP_T1w_space-MNI152NLin2009cAsym_dtissue.nii.gz
|   |   |-- sub-1017SP_T1w_space-MNI152NLin2009cAsym_preproc.nii.gz
|   |   |-- sub-1017SP_T1w_space-MNI152NLin2009cAsym_target-T1w_warp.h5
|   |   |-- sub-1017SP_T1w_target-MNI152NLin2009cAsym_warp.h5
|   |   |-- sub-1017SP_T1w_target-fsnative_affine.txt
|   |   |-- sub-1017SP_run-01_T1w_space-orig_target-T1w_affine.txt
|   |   `-- sub-1017SP_run-02_T1w_space-orig_target-T1w_affine.txt
|   |-- figures
|   |   |-- sub-1017SP_T1w_reconall.svg
|   |   |-- sub-1017SP_T1w_seg_brainmask.svg
|   |   |-- sub-1017SP_T1w_t1_2_mni.svg
|   |   |-- sub-1017SP_task-rest_run-01_bold_bbr.svg
|   |   |-- sub-1017SP_task-rest_run-01_bold_carpetplot.svg
|   |   |-- sub-1017SP_task-rest_run-01_bold_rois.svg
|   |   `-- sub-1017SP_task-rest_run-01_bold_sdc_syn.svg
|   `-- func
|       |-- sub-1017SP_task-rest_run-01_bold_confounds.tsv
|       |-- sub-1017SP_task-rest_run-01_bold_space-MNI152NLin2009cAsym_brainmask.nii.gz
|       |-- sub-1017SP_task-rest_run-01_bold_space-MNI152NLin2009cAsym_preproc.nii.gz
|       |-- sub-1017SP_task-rest_run-01_bold_space-T1w_brainmask.nii.gz
|       |-- sub-1017SP_task-rest_run-01_bold_space-T1w_label-aparcaseg_roi.nii.gz
|       |-- sub-1017SP_task-rest_run-01_bold_space-T1w_label-aseg_roi.nii.gz
|       `-- sub-1017SP_task-rest_run-01_bold_space-T1w_preproc.nii.gz