opendatacube / datacube-stats

Data Cube Temporal Statistic Tools
http://www.ga.gov.au/about/projects/geographic/digital-earth-australia
Other
22 stars 6 forks source link

Exceptions thrown with Sentinel-2 data #173

Closed daleroberts closed 4 years ago

daleroberts commented 5 years ago

I'm getting a thrown exception in datacube-stats when processing sentinel-2 in certain areas:

2019-02-06 23:43:38,451 20288 datacube_stats.main ERROR Error processing task: StatsTask(time_period=(Timestamp('2014-01-01 00:00:00'), Timestamp('2020-01-01 00:00:00')), spatial_id={'x': 56, 'y': -186})
2019-02-06 23:43:38,880 20224 digitalearthau.qsub ERROR Task failed: Error processing task: StatsTask(time_period=(Timestamp('2014-01-01 00:00:00'), Timestamp('2020-01-01 00:00:00')), spatial_id={'x': 56, 'y': -186})
concurrent.futures.process._RemoteTraceback:
"""
Traceback (most recent call last):
  File "/g/data1a/u46/users/dxr251/code/dea/datacube-stats/datacube_stats/main.py", line 510, in execute_task
    process_chunk(output_files, sub_tile_slice, task, timer)
  File "/g/data1a/u46/users/dxr251/code/dea/datacube-stats/datacube_stats/main.py", line 565, in load_process_save_chunk
    data = load_data(chunk, task.sources, geom=geom)
  File "/g/data1a/u46/users/dxr251/code/dea/datacube-stats/datacube_stats/main.py", line 623, in load_data
    for source_prod in sources]  # list of datasets
  File "/g/data1a/u46/users/dxr251/code/dea/datacube-stats/datacube_stats/main.py", line 623, in <listcomp>
    for source_prod in sources]  # list of datasets
  File "/g/data1a/u46/users/dxr251/code/dea/datacube-stats/datacube_stats/main.py", line 789, in load_masked_data
    skip_broken_datasets=True)
  File "/g/data1a/u46/users/dxr251/code/dea/datacube-core/datacube/api/grid_workflow.py", line 388, in load
    skip_broken_datasets=skip_broken_datasets)
  File "/g/data1a/u46/users/dxr251/code/dea/datacube-core/datacube/api/core.py", line 522, in load_data
    skip_broken_datasets=skip_broken_datasets)
  File "/g/data1a/u46/users/dxr251/code/dea/datacube-core/datacube/api/core.py", line 438, in _xr_load
    skip_broken_datasets=skip_broken_datasets)
  File "/g/data1a/u46/users/dxr251/code/dea/datacube-core/datacube/api/core.py", line 642, in _fuse_measurement
    skip_broken_datasets=skip_broken_datasets)
  File "/g/data1a/u46/users/dxr251/code/dea/datacube-core/datacube/storage/_load.py", line 60, in reproject_and_fuse
    roi = read_time_slice(rdr, buffer_, dst_gbox, resampling, dst_nodata)
  File "/g/data1a/u46/users/dxr251/code/dea/datacube-core/datacube/storage/_read.py", line 164, in read_time_slice
    src_gbox = src_gbox[rr.roi_src]
  File "/g/data1a/u46/users/dxr251/code/dea/datacube-core/datacube/utils/geometry/_base.py", line 830, in __getitem__
    return GeoBox(width=w, height=h, affine=affine, crs=self.crs)
  File "/g/data1a/u46/users/dxr251/code/dea/datacube-core/datacube/utils/geometry/_base.py", line 765, in __init__
    assert height > 0 and width > 0, "Can't create GeoBox of zero size"
AssertionError: Can't create GeoBox of zero size

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/g/data/v10/public/modules/dea-env/20181015/lib/python3.6/concurrent/futures/process.py", line 175, in _process_worker
    r = call_item.fn(*call_item.args, **call_item.kwargs)
  File "/g/data1a/u46/users/dxr251/code/dea/datacube-stats/datacube_stats/main.py", line 519, in execute_task
    raise StatsProcessingException("Error processing task: %s" % task)
datacube_stats.main.StatsProcessingException: Error processing task: StatsTask(time_period=(Timestamp('2014-01-01 00:00:00'), Timestamp('2020-01-01 00:00:00')), spatial_id={'x': 56, 'y': -186})
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/g/data1a/u46/users/dxr251/code/dea/digitalearthau/digitalearthau/qsub.py", line 504, in run_tasks
    actual_result = executor.result(result)
  File "/g/data1a/u46/users/dxr251/code/dea/datacube-core/datacube/executor.py", line 218, in result
    return future.result()
  File "/g/data/v10/public/modules/dea-env/20181015/lib/python3.6/concurrent/futures/_base.py", line 425, in result
    return self.__get_result()
  File "/g/data/v10/public/modules/dea-env/20181015/lib/python3.6/concurrent/futures/_base.py", line 384, in __get_result
    raise self._exception
datacube_stats.main.StatsProcessingException: Error processing task: StatsTask(time_period=(Timestamp('2014-01-01 00:00:00'), Timestamp('2020-01-01 00:00:00')), spatial_id={'x': 56, 'y': -186})
2019-02-06 23:43:38,885 20224 digitalearthau.qsub INFO 0 successful, 278 failed
Kirill888 commented 5 years ago

This should be resolved in datacube-core now.

uchchwhash commented 4 years ago

Closing this, will re-open if @daleroberts faces it again.