search

sul-dlss / gis-robot-suite

Robots for GIS accessioning and delivery
Other
9 stars 4 forks source link

load-geoserver: cannot save Coverage #775

Closed edsu closed 7 months ago

edsu commented 8 months ago

From the gis-robot-suite production log It appears that druid:cf812bg1349 is in a state where it cannot be accessioned because it is getting stuck in load-geoserver with an error: cf812bg1349 cannot save Coverage: 500.

I, [2024-02-06T12:05:16.344863 #3115990]  INFO -- : druid:cf812bg1349 processing extract-iso19139-metadata (gisAssemblyWF)
I, [2024-02-06T12:05:16.378897 #3115990]  INFO -- : extracting metadata: generating /gis_workflow_data/stage/cf812bg1349/temp/G5754_L7_1783_B6-iso19139.xml using /opt/app/lyberadmin/gis-robot-suite/releases/20240206034811/config/ArcGIS/Transforms/ArcGIS2ISO19139.xsl
I, [2024-02-06T12:05:16.451851 #3115986]  INFO -- : druid:cf812bg1349 processing extract-iso19110-metadata (gisAssemblyWF)
I, [2024-02-06T12:05:16.454526 #3115990]  INFO -- : Finished druid:cf812bg1349 in 0.0556s
I, [2024-02-06T12:05:16.503979 #3115985]  INFO -- : druid:cf812bg1349 processing extract-fgdc-metadata (gisAssemblyWF)
I, [2024-02-06T12:05:16.505841 #3115986]  INFO -- : Finished druid:cf812bg1349 in 0.0031s
I, [2024-02-06T12:05:16.537022 #3115985]  INFO -- : extracting metadata: generating /gis_workflow_data/stage/cf812bg1349/temp/G5754_L7_1783_B6-fgdc.xml using /opt/app/lyberadmin/gis-robot-suite/releases/20240206034811/config/ArcGIS/Transforms/ArcGIS2FGDC.xsl
I, [2024-02-06T12:05:16.575777 #3115990]  INFO -- : druid:cf812bg1349 processing generate-geo-metadata (gisAssemblyWF)
I, [2024-02-06T12:05:16.578177 #3115985]  INFO -- : Finished druid:cf812bg1349 in 0.0198s
I, [2024-02-06T12:05:16.783942 #3115986]  INFO -- : druid:cf812bg1349 processing generate-mods (gisAssemblyWF)
I, [2024-02-06T12:05:16.785652 #3115990]  INFO -- : Finished druid:cf812bg1349 in 0.1501s
I, [2024-02-06T12:05:17.086608 #3115985]  INFO -- : druid:cf812bg1349 processing assign-placenames (gisAssemblyWF)
I, [2024-02-06T12:05:17.088334 #3115986]  INFO -- : Finished druid:cf812bg1349 in 0.2510s
I, [2024-02-06T12:05:17.478498 #3115990]  INFO -- : druid:cf812bg1349 processing package-data (gisAssemblyWF)
I, [2024-02-06T12:05:17.482272 #3115985]  INFO -- : Finished druid:cf812bg1349 in 0.3350s
I, [2024-02-06T12:05:28.178860 #3115986]  INFO -- : druid:cf812bg1349 processing normalize-data (gisAssemblyWF)
I, [2024-02-06T12:05:28.181099 #3115990]  INFO -- : Finished druid:cf812bg1349 in 10.6423s
I, [2024-02-06T12:05:30.214175 #3115986]  INFO -- : normalize-data: cf812bg1349 is compressing to EPSG:4326
I, [2024-02-06T12:05:33.676255 #3115986]  INFO -- : normalize-data: adding alpha channel for /var/geomdtk/current/tmp/normalize_cf812bg1349/EPSG_4326/G5754_L7_1783_B6.tif
I, [2024-02-06T12:05:47.418470 #3115985]  INFO -- : druid:cf812bg1349 processing extract-boundingbox (gisAssemblyWF)
I, [2024-02-06T12:05:47.420531 #3115986]  INFO -- : Finished druid:cf812bg1349 in 19.1903s
I, [2024-02-06T12:05:47.450520 #3115985]  INFO -- : extract-boundingbox: cf812bg1349 is extracting data: /gis_workflow_data/stage/cf812bg1349/content/data_EPSG_4326.zip
I, [2024-02-06T12:05:49.664700 #3115990]  INFO -- : druid:cf812bg1349 processing generate-content-metadata (gisAssemblyWF)
I, [2024-02-06T12:05:49.665067 #3115985]  INFO -- : Finished druid:cf812bg1349 in 2.1852s
I, [2024-02-06T12:05:51.363283 #3115986]  INFO -- : druid:cf812bg1349 processing finish-gis-assembly-workflow (gisAssemblyWF)
I, [2024-02-06T12:05:51.365029 #3115990]  INFO -- : Finished druid:cf812bg1349 in 1.6429s
I, [2024-02-06T12:05:51.531335 #3115986]  INFO -- : finish-gis-assembly-workflow: cf812bg1349 migrating object to /var/geomdtk/current/workspace/cf/812/bg/1349/cf812bg1349 from /gis_workflow_data/stage/cf812bg1349
I, [2024-02-06T12:05:54.020312 #3115990]  INFO -- : druid:cf812bg1349 processing start-delivery-workflow (gisAssemblyWF)
I, [2024-02-06T12:05:54.021886 #3115986]  INFO -- : Finished druid:cf812bg1349 in 2.6057s
I, [2024-02-06T12:05:54.133900 #3115990]  INFO -- : Finished druid:cf812bg1349 in 0.0700s
I, [2024-02-06T12:05:54.140892 #3115990]  INFO -- : druid:cf812bg1349 processing load-vector (gisDeliveryWF)
I, [2024-02-06T12:05:54.256967 #3115990]  INFO -- : load-vector: cf812bg1349 is not a vector, skipping
I, [2024-02-06T12:05:54.285334 #3115990]  INFO -- : Finished druid:cf812bg1349 in 0.0892s
I, [2024-02-06T12:05:54.286585 #3115990]  INFO -- : druid:cf812bg1349 processing load-raster (gisDeliveryWF)
I, [2024-02-06T12:06:00.221453 #3115990]  INFO -- : Finished druid:cf812bg1349 in 5.8855s
I, [2024-02-06T12:06:00.222734 #3115990]  INFO -- : druid:cf812bg1349 processing load-geoserver (gisDeliveryWF)
E, [2024-02-06T12:06:00.415763 #3115990] ERROR -- : load-geoserver: cf812bg1349 cannot save Coverage: 500

Should this Item be processable in its current state or is something missing from the data that is being submitted?

One way to get started on this would be to retrieve the data from production kurma-robots-prod-01:/gis_workflow_data/stage/cf812bg1349/content/data.zip, register a new item in Argo, and use Preassembly to load in the unzipped data, while watching the stage Geoserver logs earthworks-geoserver-stage-a.

kimdurante commented 8 months ago

@edsu I have recreated the error in Argo for this object if you want to try and troubleshoot

edsu commented 8 months ago

Ah, so at least the error does get surfaced in Argo. That's good at least.

edsu commented 7 months ago

I think I've observed this failing in Stage and then working when I retry the step in Argo. This made me think that perhaps it is timing related, and retries could help? See #786

edsu commented 7 months ago

The data for this no longer seems to be available. I'm going to close this, and fingers crossed we don't see it pop up again.