actinia-org / actinia-jupyter

Jupyter notebooks for the actinia tutorial
GNU General Public License v3.0
4 stars 2 forks source link

actinia_introduction.ipynb: Sentinel-2 NDVI computation failing with Google BigQuery error #6

Open neteler opened 2 years ago

neteler commented 2 years ago

The https://github.com/mundialis/actinia-jupyter/blob/main/notebooks/actinia_introduction.ipynb notebook fails in section

Landsat and Sentinel-2 NDVI computation --> Sentinel-2 scene

with

actinia POST request:
https://actinia.mundialis.de/api/v3/sentinel2_process/ndvi/S2A_MSIL1C_20170212T104141_N0204_R008_T31TGJ_20170212T104138
---
Waiting for the process to finish...

ERROR: actinia processing failed with status code 400!
See errors below:
{
  "accept_datetime": "2022-06-17 13:50:35.952910",
  "accept_timestamp": 1655473835.9528964,
  "api_info": {
    "endpoint": "asyncephemeralsentinel2processingresource",
    "method": "POST",
    "path": "/api/v3/sentinel2_process/ndvi/S2A_MSIL1C_20170212T104141_N0204_R008_T31TGJ_20170212T104138",
    "request_url": "http://actinia.mundialis.de/api/v3/sentinel2_process/ndvi/S2A_MSIL1C_20170212T104141_N0204_R008_T31TGJ_20170212T104138"
  },
  "datetime": "2022-06-17 13:50:36.093800",
  "exception": {
    "message": "AsyncProcessError:  Error in querying Sentinel-2 product <S2A_MSIL1C_20170212T104141_N0204_R008_T31TGJ_20170212T104138> in Google BigQuery Sentinel-2 database. Error: GoogleCloudAPIError:  An error occurred while fetching Sentinel-2 download URL's. Error message: File /etc/GCS_credentials.json was not found.",
    "traceback": [
      "  File \"/usr/lib/python3.8/site-packages/actinia_core/rest/ephemeral_processing.py\", line 1767, in run\n    self._execute()\n",
      "  File \"/usr/lib/python3.8/site-packages/actinia_satellite_plugin/ephemeral_sentinel2_ndvi_processor.py\", line 969, in _execute\n    self._prepare_sentinel2_download()\n",
      "  File \"/usr/lib/python3.8/site-packages/actinia_satellite_plugin/ephemeral_sentinel2_ndvi_processor.py\", line 789, in _prepare_sentinel2_download\n    raise AsyncProcessError(\"Error in querying Sentinel-2 product <%s> \"\n"
    ],
    "type": "<class 'actinia_core.core.common.exceptions.AsyncProcessError'>"
  },
  "http_code": 400,
  "message": "AsyncProcessError:  Error in querying Sentinel-2 product <S2A_MSIL1C_20170212T104141_N0204_R008_T31TGJ_20170212T104138> in Google BigQuery Sentinel-2 database. Error: GoogleCloudAPIError:  An error occurred while fetching Sentinel-2 download URL's. Error message: File /etc/GCS_credentials.json was not found.",
  "process_chain_list": [],
  "process_log": [],
  "progress": {
    "num_of_steps": 0,
    "step": 0
  },
  "resource_id": "resource_id-3220d63c-4e57-49fc-9db9-2ece3acb0153",
  "status": "error",
  "time_delta": 0.14093279838562012,
  "timestamp": 1655473836.0937555,
  "urls": {
    "resources": [],
    "status": "https://actinia.mundialis.de/api/v3/resources/demouser/resource_id-3220d63c-4e57-49fc-9db9-2ece3acb0153"
  },
  "user_id": "demouser"
}

---------------------------------------------------------------------------
Exception                                 Traceback (most recent call last)
<ipython-input-29-b09d158c6c6b> in <module>
     25 
     26     # check if anything went wrong
---> 27     verify_request(request, 200)
     28 
     29     print("NDVI computation of Sentinel-2 scene S2A_MSIL1C_20170212T104141_N0204_R008_T31TGJ_20170212T104138:")

<ipython-input-21-8d559294337a> in verify_request(request, success_code)
     12         request_url = request.json()["urls"]["status"]
     13         requests.delete(url=request_url, auth=actinia_auth)
---> 14         raise Exception("The resource <%s> has been terminated." % request_url)

Exception: The resource <https://actinia.mundialis.de/api/v3/resources/demouser/resource_id-3220d63c-4e57-49fc-9db9-2ece3acb0153> has been terminated.

This will be related to https://github.com/mundialis/actinia_satellite_plugin/issues/11

neteler commented 2 years ago

Affects also notebooks/actinia_sentinel2_ndvi.ipynb