bossie
commented
3 weeks ago It does seem to work if the load_stac is in a sync call instead of a batch job but fails further on (indeed in the "load_stac of own job results" branch):
Traceback (most recent call last):
File "/opt/openeo/lib/python3.8/site-packages/flask/app.py", line 1484, in full_dispatch_request
rv = self.dispatch_request()
File "/opt/openeo/lib/python3.8/site-packages/flask/app.py", line 1469, in dispatch_request
return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args)
File "/opt/openeo/lib/python3.8/site-packages/openeo_driver/users/auth.py", line 95, in decorated
return f(*args, **kwargs)
File "/opt/openeo/lib/python3.8/site-packages/openeo_driver/views.py", line 673, in result
result = backend_implementation.processing.evaluate(process_graph=process_graph, env=env)
File "/opt/openeo/lib/python3.8/site-packages/openeo_driver/ProcessGraphDeserializer.py", line 301, in evaluate
return evaluate(process_graph=process_graph, env=env)
File "/opt/openeo/lib/python3.8/site-packages/openeo_driver/ProcessGraphDeserializer.py", line 377, in evaluate
result = convert_node(result_node, env=env)
File "/opt/openeo/lib/python3.8/site-packages/openeo_driver/ProcessGraphDeserializer.py", line 402, in convert_node
process_result = apply_process(process_id=process_id, args=processGraph.get('arguments', {}),
File "/opt/openeo/lib/python3.8/site-packages/openeo_driver/ProcessGraphDeserializer.py", line 1581, in apply_process
args = {name: convert_node(expr, env=env) for (name, expr) in sorted(args.items())}
File "/opt/openeo/lib/python3.8/site-packages/openeo_driver/ProcessGraphDeserializer.py", line 1581, in <dictcomp>
args = {name: convert_node(expr, env=env) for (name, expr) in sorted(args.items())}
File "/opt/openeo/lib/python3.8/site-packages/openeo_driver/ProcessGraphDeserializer.py", line 416, in convert_node
return convert_node(processGraph['node'], env=env)
File "/opt/openeo/lib/python3.8/site-packages/openeo_driver/ProcessGraphDeserializer.py", line 402, in convert_node
process_result = apply_process(process_id=process_id, args=processGraph.get('arguments', {}),
File "/opt/openeo/lib/python3.8/site-packages/openeo_driver/ProcessGraphDeserializer.py", line 1613, in apply_process
return process_function(args=ProcessArgs(args, process_id=process_id), env=env)
File "/opt/openeo/lib/python3.8/site-packages/openeo_driver/ProcessGraphDeserializer.py", line 2234, in load_stac
return env.backend_implementation.load_stac(url=url, load_params=load_params, env=env)
File "/opt/openeo/lib/python3.8/site-packages/openeogeotrellis/backend.py", line 760, in load_stac
return load_stac.load_stac(url, load_params, env, layer_properties={}, batch_jobs=self.batch_jobs)
File "/opt/openeo/lib/python3.8/site-packages/openeogeotrellis/load_stac.py", line 145, in load_stac
pystac_item = pystac.Item(id=asset_id, geometry=asset["geometry"], bbox=asset["bbox"],
KeyError: 'geometry'
Reported by @VictorVerhaert.
Main job
j-240605ef616e4f65bf465d15c84030bcon cdse-prod by userfaba0f95-04b7-4560-aeb4-c0172dd9de09is attempting aload_stacof job results by means of the unsigned URL:Dependency job
j-240605a639644099b2d8d8cabe62b971is a job by the same user, also on cdse-prod:Considering both jobs are by the same user and on the same back-end, using the unsigned URL should Just Work without actually fetching the URL, but instead it fails with a 401 Unauthorized&_a=(columns:!(levelname,message,job_id),filters:!(('$state':(store:appState),meta:(alias:!n,disabled:!f,index:'592a42f0-e665-11ec-8cc4-3747d5233c59',key:job_id,negate:!f,params:(query:j-240605ef616e4f65bf465d15c84030bc),type:phrase),query:(match:(job_id:(query:j-240605ef616e4f65bf465d15c84030bc,type:phrase)))),('$state':(store:appState),meta:(alias:!n,disabled:!f,index:'592a42f0-e665-11ec-8cc4-3747d5233c59',key:levelname,negate:!t,params:(query:DEBUG),type:phrase),query:(match:(levelname:(query:DEBUG,type:phrase))))),index:'592a42f0-e665-11ec-8cc4-3747d5233c59',interval:auto,query:(language:kuery,query:''),sort:!(!('@timestamp',desc)))):
From the logs I gather that it doesn't consider both jobs from the same user and therefore proceeds with actually fetching the STAC URL, which (rightfully) doesn't work as it is unsigned: