Open falkamelung opened 3 years ago
This is what I was looking at to find a solution last week, seems like it is from c code, I could not find the source. somewhere it uses the address in merged/slc//.vrt to find the corresponding bursts before merging and by default it searches based on isce folders arrangement, it goes to ../../../ to find coreg_secondarys and reference folder. I don't know where is this happening, we should ask ISCE team
The function that fails is /TopsProc/runBurstIfg.py. After copying /reference
to /tmp
it fails in slc2.createImage() and, more precisely, it fails in DataAccessor/DataAccessorPy.py.
I get the message
GDAL open (R): /tmp/merged/SLC/20160629/20160629.slc.full.vrt
ERROR 4: /tmp/merged/SLC/20160629/../../../coreg_secondarys/20160629/IW1/burst_01.slc.vrt: No such file or directory
Error. Cannot open the file /tmp/merged/SLC/20160629/20160629.slc.full.vrt in read mode.
Error in file /home/conda/feedstock_root/build_artifacts/isce2_1605839897087/work/build/components/iscesys/ImageApi/InterleavedAccessor/src/GDALAccessor.cpp at line 77 Exiting
The question is why does it want to open coreg_secondarys/20160629/IW1/burst_01.slc.vrt
? It is listed in /tmp/merged/SLC/20160629/20160629.slc.full.vrt
.
I tried just copying burst_01.slc.vrt
to /tmp
but it insisted on a full-size burst_01.slc.
TheWe implemented copy-to-local-disk of '/merged/SLC/20160605' dir for run_10_filter_coherence step because the merged SLCs are used to create the complex coherence
fine.cor
:However, we got the error
It turns out that
FilterAndCoherence
wants to open several vrt files because ofrelativetoVRT
strings in the vrt files.The first issue is solved by copy-to-local-disk of
/reference
but we could not resolve the second issue with the current version ofdistribute.bash
. It does not allow to specify the destination directory (it copiescoreg_secondarys/20160711
to/tmp/20160711
but we need it incoreg_secondarys/20160711
). We therefore removed copy-to-local-disc ofmerged/SLC
using https://github.com/geodesymiami/rsmas_insar/commit/ba5b09c9d879b6eedf387399b9ad608acb99900bI don't think the
burst_01.slc.vrt
is really required. Can ISCE be modified so that unnecessary *vrt files are not opened? It happens incomputeCoherence
.Here a description of the limitation of
distribute.bash
:distribute.bash coreg_secondarys/20160711
results in/tmp/20160711
on the node.distribute.bash coreg_secondarys
results in/tmp/coreg_secondarys
but it would copy all directories in/coreg_secondarys
, including those we don't need for this job/node, so this is not an option. We would distribute.bash to accept the destination directory:distribute.bash coreg_secondarys/20160711 coreg_secondarys
to result in/tmp/coreg_secondarys/20160711
I see two alternatives:
/scratch/coreg_secondarys_jobid
, usedistribute.bash
for copying to/tmp
and rename to/tmp/coreg_secondarys
.cp
instead ofdistribute.bash
I