ASFHyP3 / hyp3-autorift

A HyP3 plugin for feature tracking processing with AutoRIFT-ISCE
BSD 3-Clause "New" or "Revised" License
7 stars 2 forks source link

Revert google cloud #210

Closed jhkennedy closed 1 year ago

jhkennedy commented 1 year ago

This reverts pulling Sentinel-2 scenes from google cloud so that we're again pulling from AWS to resolve #207.

Additionally:

TODOs:

jhkennedy commented 1 year ago

Trufflhog is just complaining about some XML we removed, so is safe to ignore.

jhkennedy commented 1 year ago

Note: Google cloud seems to be working again so closing this... until we need it again (hopefully, never).

asjohnston-asf commented 1 year ago

I was able to run S2B_MSIL1C_20200105T152259_N0208_R039_T13CES_20200105T181230,S2B_MSIL1C_20200315T152259_N0209_R039_T13CES_20200315T181115 succesfully, but the second pair I tried raised a KeyError:

$ docker run -v /home/asjohnston/.aws:/home/conda/.aws ghcr.io/asfhyp3/hyp3-autorift:0.10.5.dev9_g5dbd07c S2A_MSIL1C_20160309T194651_N0201_R013_T01CDP_20160311T120856 S2A_MSIL1C_20170113T194511_N0204_R013_T01CDP_20170113T194513
This is the Open Source version of ISCE.
Some of the workflows depend on a separate licensed package.
To obtain the licensed package, please make a request for ISCE
through the website: https://download.jpl.nasa.gov/ops/request/index.cfm.
Alternatively, if you are a member, or can become a member of WinSAR
you may be able to obtain access to a version of the licensed sofware at
https://winsar.unavco.org/software/isce
2023-04-10 18:52:49,830 - matplotlib - DEBUG - matplotlib data path: /opt/conda/envs/hyp3-autorift/lib/python3.9/site-packages/matplotlib/mpl-data
2023-04-10 18:52:49,835 - matplotlib - DEBUG - CONFIGDIR=/home/conda/.config/matplotlib
2023-04-10 18:52:49,836 - matplotlib - DEBUG - interactive is False
2023-04-10 18:52:49,836 - matplotlib - DEBUG - platform is linux
2023-04-10 18:52:49,898 - matplotlib - DEBUG - CACHEDIR=/home/conda/.cache/matplotlib
2023-04-10 18:52:49,898 - matplotlib.font_manager - DEBUG - font search path [PosixPath('/opt/conda/envs/hyp3-autorift/lib/python3.9/site-packages/matplotlib/mpl-data/fonts/ttf'), PosixPath('/opt/conda/envs/hyp3-autorift/lib/python3.9/site-packages/matplotlib/mpl-data/fonts/afm'), PosixPath('/opt/conda/envs/hyp3-autorift/lib/python3.9/site-packages/matplotlib/mpl-data/fonts/pdfcorefonts')]
2023-04-10 18:52:50,142 - matplotlib.font_manager - INFO - generated new fontManager
2023-04-10 18:52:59,080 - hyp3_autorift.process - INFO - Reference scene path: /vsis3/sentinel-s2-l1c/tiles/1/C/DP/2016/3/9/0/B08.jp2
2023-04-10 18:52:59,081 - hyp3_autorift.process - INFO - Secondary scene path: /vsis3/sentinel-s2-l1c/tiles/1/C/DP/2017/1/13/0/B08.jp2
Traceback (most recent call last):
  File "/opt/conda/envs/hyp3-autorift/lib/python3.9/runpy.py", line 197, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/opt/conda/envs/hyp3-autorift/lib/python3.9/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/opt/conda/envs/hyp3-autorift/lib/python3.9/site-packages/hyp3_autorift/__main__.py", line 65, in <module>
    main()
  File "/opt/conda/envs/hyp3-autorift/lib/python3.9/site-packages/hyp3_autorift/__main__.py", line 55, in main
    product_file, browse_file = process(g1, g2, parameter_file=args.parameter_file, naming_scheme=args.naming_scheme)
  File "/opt/conda/envs/hyp3-autorift/lib/python3.9/site-packages/hyp3_autorift/process.py", line 454, in process
    meta_r, meta_s = coregisterLoadMetadata(
  File "/opt/conda/envs/hyp3-autorift/lib/python3.9/site-packages/hyp3_autorift/vend/testGeogridOptical.py", line 113, in coregisterLoadMetadata
    s2_name = kwargs['reference_metadata']['properties']['sentinel:product_id']
KeyError: 'sentinel:product_id'