search

ceos-seo / data_cube_ui

Data Cube user interface allowing users to interact with the Data Cube and run sample analysis cases
http://ceos-cube.org/
Apache License 2.0
47 stars 51 forks source link

Using Landsat 8 from AWS s3 #34

Open zi-dan opened 4 years ago

zi-dan commented 4 years ago

I try to use Landast 8 ingested from AWS via s3 interface in ODC UI. However processing of data stopped with following exception:

[2019-12-20 01:14:00,944: ERROR/ForkPoolWorker-7] Chord callback for '6b18fe19-a5ba-4ca1-8aae-4e8f1f1aece4' raised: ChordError("Dependency 1da5ae41-cede-4ef7-9476-25fb31004acb raised IndexE
rror('only integers, slices (`:`), ellipsis (`...`), numpy.newaxis (`None`) and integer or boolean arrays are valid indices',)",)
Traceback (most recent call last):
  File "/home/localuser/Datacube/datacube_env/lib/python3.6/site-packages/celery/app/trace.py", line 385, in trace_task
    R = retval = fun(*args, **kwargs)
  File "/home/localuser/Datacube/datacube_env/lib/python3.6/site-packages/celery/app/trace.py", line 648, in __protected_call__
    return self.run(*args, **kwargs)
  File "/home/localuser/Datacube/data_cube_ui/apps/water_detection/tasks.py", line 299, in processing_task
    no_data=task.satellite.no_data_value)
  File "/home/localuser/Datacube/data_cube_ui/utils/data_cube_utilities/dc_water_classifier.py", line 294, in wofs_classify
    classified_clean[clean_mask] = classified[clean_mask]  # Contains data for clear pixels
IndexError: only integers, slices (`:`), ellipsis (`...`), numpy.newaxis (`None`) and integer or boolean arrays are valid indices

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/localuser/Datacube/datacube_env/lib/python3.6/site-packages/celery/backends/redis.py", line 399, in on_chord_part_return
    callback.delay([unpack(tup, decode) for tup in resl])
  File "/home/localuser/Datacube/datacube_env/lib/python3.6/site-packages/celery/backends/redis.py", line 399, in <listcomp>
    callback.delay([unpack(tup, decode) for tup in resl])
  File "/home/localuser/Datacube/datacube_env/lib/python3.6/site-packages/celery/backends/redis.py", line 352, in _unpack_chord_result
    raise ChordError('Dependency {0} raised {1!r}'.format(tid, retval))
celery.exceptions.ChordError: Dependency 1da5ae41-cede-4ef7-9476-25fb31004acb raised IndexError('only integers, slices (`:`), ellipsis (`...`), numpy.newaxis (`None`) and integer or boolean
 arrays are valid indices',)
[2019-12-20 01:14:00,948: ERROR/ForkPoolWorker-7] Task water_detection.processing_task[1da5ae41-cede-4ef7-9476-25fb31004acb] raised unexpected: IndexError('only integers, slices (`:`), elli
psis (`...`), numpy.newaxis (`None`) and integer or boolean arrays are valid indices',)
Traceback (most recent call last):
  File "/home/localuser/Datacube/datacube_env/lib/python3.6/site-packages/celery/app/trace.py", line 385, in trace_task
    R = retval = fun(*args, **kwargs)
  File "/home/localuser/Datacube/datacube_env/lib/python3.6/site-packages/celery/app/trace.py", line 648, in __protected_call__
    return self.run(*args, **kwargs)
  File "/home/localuser/Datacube/data_cube_ui/apps/water_detection/tasks.py", line 299, in processing_task
    no_data=task.satellite.no_data_value)
  File "/home/localuser/Datacube/data_cube_ui/utils/data_cube_utilities/dc_water_classifier.py", line 294, in wofs_classify
    classified_clean[clean_mask] = classified[clean_mask]  # Contains data for clear pixels
IndexError: only integers, slices (`:`), ellipsis (`...`), numpy.newaxis (`None`) and integer or boolean arrays are valid indices
[2019-12-20 01:14:01,588: INFO/ForkPoolWorker-7] Task water_detection.recombine_geographic_chunks[e4170071-931b-401c-be6b-3afc06e3fc8b] succeeded in 0.005194195080548525s: None

Does anyone give me any advice how to make something with this error or provide working samples or settings for L8/AWS-S3?