search

WorldCereal / worldcereal-classification

This repository contains the classification module of the WorldCereal system.
https://esa-worldcereal.org/
MIT License
37 stars 4 forks source link

JobFailedException: Batch job '' didn't finish successfully. Status: error on Terrascope for crop land and crop type generation #220

Closed mal147 closed 1 week ago

mal147 commented 1 week ago

Hello, I've tried to run the crop land and crop type notebook through Terrascope and I have an error on both case trying to generate the map (even with a very small area). Here is my error for crop type:

Thank you for your help!

0:00:00 Job 'j-2411074f70124e3ba50c0dc3c260c329': send 'start' 0:01:02 Job 'j-2411074f70124e3ba50c0dc3c260c329': created (progress 0%) 0:01:10 Job 'j-2411074f70124e3ba50c0dc3c260c329': created (progress 0%) 0:01:23 Job 'j-2411074f70124e3ba50c0dc3c260c329': created (progress 0%) 0:01:34 Job 'j-2411074f70124e3ba50c0dc3c260c329': created (progress 0%) 0:01:51 Job 'j-2411074f70124e3ba50c0dc3c260c329': created (progress 0%) 0:02:14 Job 'j-2411074f70124e3ba50c0dc3c260c329': created (progress 0%) 0:02:34 Job 'j-2411074f70124e3ba50c0dc3c260c329': created (progress 0%) 0:03:00 Job 'j-2411074f70124e3ba50c0dc3c260c329': running (progress N/A) 0:03:29 Job 'j-2411074f70124e3ba50c0dc3c260c329': running (progress N/A) 0:04:09 Job 'j-2411074f70124e3ba50c0dc3c260c329': running (progress N/A) 0:04:58 Job 'j-2411074f70124e3ba50c0dc3c260c329': running (progress N/A) 0:05:50 Job 'j-2411074f70124e3ba50c0dc3c260c329': running (progress N/A) 0:06:54 Job 'j-2411074f70124e3ba50c0dc3c260c329': running (progress N/A) 0:08:01 Job 'j-2411074f70124e3ba50c0dc3c260c329': running (progress N/A) 0:09:10 Job 'j-2411074f70124e3ba50c0dc3c260c329': running (progress N/A) 0:10:17 Job 'j-2411074f70124e3ba50c0dc3c260c329': running (progress N/A) 0:11:27 Job 'j-2411074f70124e3ba50c0dc3c260c329': running (progress N/A) 0:12:35 Job 'j-2411074f70124e3ba50c0dc3c260c329': running (progress N/A) 0:13:41 Job 'j-2411074f70124e3ba50c0dc3c260c329': running (progress N/A) 0:14:46 Job 'j-2411074f70124e3ba50c0dc3c260c329': running (progress N/A) 0:15:48 Job 'j-2411074f70124e3ba50c0dc3c260c329': error (progress N/A) Your batch job 'j-2411074f70124e3ba50c0dc3c260c329' failed. Error logs: [{'id': '[1730988504265, 727913]', 'time': '2024-11-07T14:08:24.265Z', 'level': 'error', 'message': 'OpenEO batch job failed: java.io.IOException: tiffset -sf 42112 /tmp/GDALMetadata_1456798158402076863.xml.tmp /tmp/17293711647256079400.tif failed; output was: _TIFFVSetField: /tmp/17293711647256079400.tif: Bad value 100 for "TileWidth" tag.'}] Full logs can be inspected in an openEO (web) editor or withconnection.job('j-2411074f70124e3ba50c0dc3c260c329').logs()`.

JobFailedException Traceback (most recent call last) Cell In[36], line 15 12 processing_extent = map.get_processing_extent() 14 # Launch the job ---> 15 job_results = generate_map( 16 processing_extent, 17 processing_period, 18 output_dir=output_dir, 19 product_type=WorldCerealProductType.CROPTYPE, 20 croptype_parameters=parameters, 21 postprocess_parameters=PostprocessParameters(), 22 ) File /opt/conda/envs/worldcereal/lib/python3.10/site-packages/worldcereal/job.py:213, in generate_map(spatial_extent, temporal_extent, output_dir, product_type, cropland_parameters, croptype_parameters, postprocess_parameters, out_format, backend_context, tile_size, job_options) 210 JOB_OPTIONS.update(job_options) 212 # Execute the job --> 213 job = classes.execute_batch( 214 out_format=out_format, 215 job_options=JOB_OPTIONS, 216 title=f"WorldCereal [{product_type.value}] job", 217 description="Job that performs end-to-end WorldCereal inference", 218 filename_prefix=f"{producttype.value}{temporal_extent.startdate}{temporal_extent.end_date}", 219 ) 221 # Get look-up tables 222 luts = {} File /opt/conda/envs/worldcereal/lib/python3.10/site-packages/openeo/rest/datacube.py:2242, in DataCube.execute_batch(self, outputfile, out_format, print, max_poll_interval, connection_retry_interval, job_options, validate, format_options) 2239 out_format = guess_format(outputfile) 2241 job = self.create_job(out_format=out_format, job_options=job_options, validate=validate, format_options) -> 2242 return job.run_synchronous( 2243 outputfile=outputfile, 2244 print=print, max_poll_interval=max_poll_interval, connection_retry_interval=connection_retry_interval 2245 ) File /opt/conda/envs/worldcereal/lib/python3.10/site-packages/openeo/rest/job.py:242, in BatchJob.run_synchronous(self, outputfile, print, max_poll_interval, connection_retry_interval) 237 def run_synchronous( 238 self, outputfile: Union[str, Path, None] = None, 239 print=print, max_poll_interval=60, connection_retry_interval=30 240 ) -> BatchJob: 241 """Start the job, wait for it to finish and download result""" --> 242 self.start_and_wait( 243 print=print, max_poll_interval=max_poll_interval, connection_retry_interval=connection_retry_interval 244 ) 245 # TODO #135 support multi file result sets too? 246 if outputfile is not None: File /opt/conda/envs/worldcereal/lib/python3.10/site-packages/openeo/rest/job.py:324, in BatchJob.start_and_wait(self, print, max_poll_interval, connection_retry_interval, soft_error_max) 320 print(self.logs(level=logging.ERROR)) 321 print( 322 f"Full logs can be inspected in an openEO (web) editor or with connection.job({self.job_id!r}).logs()." 323 ) --> 324 raise JobFailedException( 325 f"Batch job {self.job_id!r} didn't finish successfully. Status: {status} (after {elapsed()}).", 326 job=self, 327 ) 329 return self JobFailedException: Batch job 'j-2411074f70124e3ba50c0dc3c260c329' didn't finish successfully. Status: error (after 0:15:55). `

mal147 commented 1 week ago

It works well today ! I can export and display results: image