insarlab / MintPy

Miami InSAR time-series software in Python
https://mintpy.readthedocs.io
Other
612 stars 260 forks source link

Un-recognized ISCE processor for metadata file: auto #675

Closed 764702025 closed 2 years ago

764702025 commented 3 years ago

Hello, I have processed ALOS-PALSAR data by stripmapStack.py before. I am trying to load these into MintPy using the following specifications in a template file named 484.template :

load_data.py -H to check more details and example inputs.

mintpy.load.processor        = isce
##---------for ISCE only:
mintpy.load.metaFile         = $/media/lichengye/C14D581BDA18EBFA/data/ALOS_PALSAR/project/484/merged/SLC/20070102/referenceShelve/data.dat
mintpy.load.baselineDir      = $/media/lichengye/C14D581BDA18EBFA/data/ALOS_PALSAR/project/484/baselines
##---------interferogram datasets:
mintpy.load.unwFile          = $/media/lichengye/C14D581BDA18EBFA/data/ALOS_PALSAR/project/484/Igrams/*/filt_*.unw
mintpy.load.corFile          = $/media/lichengye/C14D581BDA18EBFA/data/ALOS_PALSAR/project/484/Igrams/*/filt_*.cor
mintpy.load.connCompFile     = $/media/lichengye/C14D581BDA18EBFA/data/ALOS_PALSAR/project/484/Igrams/*/filt_*.unw.conncomp
##---------geometry datasets:
mintpy.load.demFile          = $/media/lichengye/C14D581BDA18EBFA/data/ALOS_PALSAR/project/484/merged/geom_reference/hgt.rdr
mintpy.load.lookupYFile      = $/media/lichengye/C14D581BDA18EBFA/data/ALOS_PALSAR/project/484/merged/geom_reference/lat.rdr
mintpy.load.lookupXFile      = $/media/lichengye/C14D581BDA18EBFA/data/ALOS_PALSAR/project/484/merged/geom_reference/lon.rdr
mintpy.load.incAngleFile     = $/media/lichengye/C14D581BDA18EBFA/data/ALOS_PALSAR/project/484/merged/geom_reference/los.rdr
mintpy.load.azAngleFile      = $/media/lichengye/C14D581BDA18EBFA/data/ALOS_PALSAR/project/484/merged/geom_reference/los.rdr
mintpy.load.shadowMaskFile   = $/media/lichengye/C14D581BDA18EBFA/data/ALOS_PALSAR/project/484/merged/geom_reference/shadowMask.rdr
mintpy.load.waterMaskFile    = $/media/lichengye/C14D581BDA18EBFA/data/ALOS_PALSAR/project/484/merged/geom_reference/waterMask.rdr
mintpy.load.bperpFile        = None

When I run smallbaseline.py 484.template :

> load_data.py --template /media/lichengye/C14D581BDA18EBFA/data/ALOS_PALSAR/project/484/mintpy/smallbaselineApp.cfg /media/lichengye/C14D581BDA18EBFA/data/ALOS_PALSAR/project/484/mintpy/484.template --project 484
processor : isce
SAR platform/sensor : unknown from project name "484"
prepare metadata files for isce products
/home/lichengye/tools/MintPy/mintpy/load_data.py:668: UserWarning: No input metadata file found: $/media/lichengye/C14D581BDA18EBFA/data/ALOS_PALSAR/project/484/merged/SLC/20070102/referenceShelve/data.dat
  warnings.warn('No input metadata file found: {}'.format(iDict['mintpy.load.metaFile']))
Traceback (most recent call last):
  File "/home/lichengye/tools/MintPy/mintpy/smallbaselineApp.py", line 1279, in <module>
    main(sys.argv[1:])
  File "/home/lichengye/tools/MintPy/mintpy/smallbaselineApp.py", line 1261, in main
    app.run(steps=inps.runSteps)
  File "/home/lichengye/tools/MintPy/mintpy/smallbaselineApp.py", line 1030, in run
    self.run_load_data(sname)
  File "/home/lichengye/tools/MintPy/mintpy/smallbaselineApp.py", line 344, in run_load_data
    mintpy.load_data.main(iargs)
  File "/home/lichengye/tools/MintPy/mintpy/load_data.py", line 828, in main
    prepare_metadata(iDict)
  File "/home/lichengye/tools/MintPy/mintpy/load_data.py", line 680, in prepare_metadata
    processor = get_processor(meta_file)
  File "/home/lichengye/tools/MintPy/mintpy/utils/isce_utils.py", line 65, in get_processor
    raise ValueError('Un-recognized ISCE processor for metadata file: {}'.format(meta_file))
ValueError: Un-recognized ISCE processor for metadata file: auto

What caused such a mistake ValueError: Un-recognized ISCE processor for metadata file: auto

welcome[bot] commented 3 years ago

👋 Thanks for opening your first issue here! Please make sure you filled out the template with as much detail as possible. We appreciate that you took the time to contribute! Make sure you read our contributing guidelines

yunjunz commented 3 years ago

This is a straightforward issue, please follow the No input metadata file found: error msg and re-check. In addition, you should use multilooked geometry files under project/484/geom_reference, not project/484/merged/geom_reference, as described in the example.

zhuhaxixiong commented 3 years ago

I meet the same problem as him ,and my config file look liks this:

########## 1. load_data
##---------add attributes manually
## MintPy requires attributes listed at: https://mintpy.readthedocs.io/en/latest/api/attributes/
## Missing attributes can be added below manually (uncomment #), e.g.
# ORBIT_DIRECTION = ascending
# PLATFORM = CSK
# ...
## a. autoPath - automatic path pattern defined in mintpy.defaults.auto_path.AUTO_PATH_*
## b. load_data.py -H to check more details and example inputs.
## c. compression to save disk usage for ifgramStack.h5 file:
## no   - save   0% disk usage, fast [default]
## lzf  - save ~57% disk usage, relative slow
## gzip - save ~62% disk usage, very slow [not recommend]
mintpy.load.processor      = auto  #[isce, aria, snap, gamma, roipac, hyp3], auto for isce
mintpy.load.autoPath       = auto  #[yes / no], auto for no, use pre-defined auto path
mintpy.load.updateMode     = auto  #[yes / no], auto for yes, skip re-loading if HDF5 files are complete
mintpy.load.compression    = auto  #[gzip / lzf / no], auto for no.
##---------for ISCE only:
mintpy.load.metaFile       = /public1/home/scf0015/mazhangfeng/merged/SLC/20080916/referenceShelve/data  #[path of common metadata file for the stack], i.e.: ./reference/IW1.xml, ./referenceShelve/data.dat
mintpy.load.baselineDir    = /public1/home/scf0015/mazhangfeng/baselines  #[path of the baseline dir], i.e.: ./baselines
##---------interferogram datasets:
mintpy.load.unwFile        = /public1/home/scf0015/mazhangfeng/Igrams/*/filt_*.unw  #[path pattern of unwrapped interferogram files]
mintpy.load.corFile        = /public1/home/scf0015/mazhangfeng/Igrams/*/filt_*.cor  #[path pattern of spatial coherence       files]
mintpy.load.connCompFile   = /public1/home/scf0015/mazhangfeng/Igrams/*/filt_*.unw.conncomp  #[path pattern of connected components    files], optional but recommend
mintpy.load.intFile        = auto  #[path pattern of wrapped interferogram   files], optional
mintpy.load.ionoFile       = auto  #[path pattern of ionospheric delay       files], optional
mintpy.load.magFile        = auto  #[path pattern of interferogram magnitude files], optional
##---------offset datasets (optional):
mintpy.load.azOffFile      = auto  #[path pattern of azimuth offset file], optional
mintpy.load.rgOffFile      = auto  #[path pattern of range   offset file], optional
mintpy.load.offSnrFile     = auto  #[path pattern of offset signal-to-noise ratio file], optional
##---------geometry datasets:
mintpy.load.demFile        = /public1/home/scf0015/mazhangfeng/geom_reference/hgt.rdr  #[path of DEM file]
mintpy.load.lookupYFile    = /public1/home/scf0015/mazhangfeng/geom_reference/lat.rdr  #[path of latitude /row   /y coordinate file], not required for geocoded data
mintpy.load.lookupXFile    = /public1/home/scf0015/mazhangfeng/geom_reference/lon.rdr  #[path of longitude/column/x coordinate file], not required for geocoded data
mintpy.load.incAngleFile   = /public1/home/scf0015/mazhangfeng/geom_reference/los.rdr  #[path of incidence angle file], optional but recommend
mintpy.load.azAngleFile    = /public1/home/scf0015/mazhangfeng/geom_reference/los.rdr  #[path of azimuth   angle file], optional
mintpy.load.shadowMaskFile = /public1/home/scf0015/mazhangfeng/geom_reference/shadowMask.hdr  #[path of shadow mask file], optional but recommend
mintpy.load.waterMaskFile  = auto  #[path of water  mask file], optional but recommend
mintpy.load.bperpFile      = auto  #[path pattern of 2D perpendicular baseline file], optional

the error is the same as him Un-recognized ISCE processor for metadata file: auto i think it is a isce issue, my isce version is 2.4.2 ,and proces ALOS 1.0 D data ,after runfiles complete,there is only one file named data in my meged/SLC/referenceShelve(no data.dir and data.bak) i also try in isce 2.5.3 installed by conda on other machine ,that seems ok! looks for your reply soon .

yunjunz commented 3 years ago

We should always look for the 1st error/warning message. In the 1st post, the real 1st error is warnings.warn('No input metadata file found: {}'.format(iDict['mintpy.load.metaFile'])). Is this your case too @zhuhaxixiong ?

You should also setup mintpy.load.processor = isce in your template file.

The issue is with isce-2 v2.4.2 only, and not with isce-2 v2.5.3. Do I understand it right?

zhuhaxixiong commented 3 years ago

thanks for your guide that i have sucessfully solve this issue,but when i use isce 2.5.3 there are no .dir .dat .bak file in the merged/SLC/reference date/refernceShelve dir, but only a data.db file.