search

aodn / content

Tracks AODN Portal content and configuration issues
0 stars 0 forks source link

talend soop_sst_harvest failing #175

Closed danfruehauf closed 7 years ago

danfruehauf commented 8 years ago

Some lines of:

2016-02-01T06:41:27000Z|GEOMETRY|OUT OF RANGE|https://thredds.aodn.org.au/thredds/dodsC/IMOS/SOOP/SOOP-SST/VNCF_Cape-Ferguson/2015/IMOS_SOOP-SST_ST_20150224T073200Z_VNCF_FV01_C-20150225T030017Z.nc|-9999.0|-9999.0|LATITUDE.compareTo(context.latMin) >= 0 failed|LONGITUDE.compareTo(context.lonMin) >= 0 failed

And many more on Solander:

2016-02-01T08:11:47000Z|GEOMETRY|OUT OF RANGE|https://thredds.aodn.org.au/thredds/dodsC/IMOS/SOOP/SOOP-SST/VMQ9273_Solander/2014/IMOS_SOOP-SST_ST_20140303T025800Z_VMQ9273_FV01_C-20140304T005922Z.nc|-9999.0|-9999.0|LATITUDE.compareTo(context.latMin) >= 0 failed|LONGITUDE.compareTo(context.lonMin) >= 0 failed
2016-02-01T08:12:10000Z|GEOMETRY|OUT OF RANGE|https://thredds.aodn.org.au/thredds/dodsC/IMOS/SOOP/SOOP-SST/VMQ9273_Solander/2014/IMOS_SOOP-SST_ST_20140219T001500Z_VMQ9273_FV01_C-20140220T005522Z.nc|-9999.0|-9999.0|LATITUDE.compareTo(context.latMin) >= 0 failed|LONGITUDE.compareTo(context.lonMin) >= 0 failed
2016-02-01T08:12:43000Z|GEOMETRY|OUT OF RANGE|https://thredds.aodn.org.au/thredds/dodsC/IMOS/SOOP/SOOP-SST/VMQ9273_Solander/2014/IMOS_SOOP-SST_ST_20140204T014500Z_VMQ9273_FV01_C-20140205T005742Z.nc|-9999.0|-9999.0|LATITUDE.compareTo(context.latMin) >= 0 failed|LONGITUDE.compareTo(context.lonMin) >= 0 failed
2016-02-01T08:12:52000Z|GEOMETRY|OUT OF RANGE|https://thredds.aodn.org.au/thredds/dodsC/IMOS/SOOP/SOOP-SST/VMQ9273_Solander/2014/IMOS_SOOP-SST_ST_20140120T180000Z_VMQ9273_FV01_C-20140121T005534Z.nc|-9999.0|-9999.0|LATITUDE.compareTo(context.latMin) >= 0 failed|LONGITUDE.compareTo(context.lonMin) >= 0 failed
2016-02-01T08:12:59000Z|GEOMETRY|OUT OF RANGE|https://thredds.aodn.org.au/thredds/dodsC/IMOS/SOOP/SOOP-SST/VMQ9273_Solander/2014/IMOS_SOOP-SST_ST_20140117T235800Z_VMQ9273_FV01_C-20140118T005542Z.nc|-9999.0|-9999.0|LATITUDE.compareTo(context.latMin) >= 0 failed|LONGITUDE.compareTo(context.lonMin) >= 0 failed
2016-02-01T08:13:01000Z|GEOMETRY|OUT OF RANGE|https://thredds.aodn.org.au/thredds/dodsC/IMOS/SOOP/SOOP-SST/VMQ9273_Solander/2014/IMOS_SOOP-SST_ST_20140116T235800Z_VMQ9273_FV01_C-20140117T005831Z.nc|-9999.0|-9999.0|LATITUDE.compareTo(context.latMin) >= 0 failed|LONGITUDE.compareTo(context.lonMin) >= 0 failed
2016-02-01T08:13:03000Z|GEOMETRY|OUT OF RANGE|https://thredds.aodn.org.au/thredds/dodsC/IMOS/SOOP/SOOP-SST/VMQ9273_Solander/2014/IMOS_SOOP-SST_ST_20140107T070500Z_VMQ9273_FV01_C-20140108T005511Z.nc|-9999.0|-9999.0|LATITUDE.compareTo(context.latMin) >= 0 failed|LONGITUDE.compareTo(context.lonMin) >= 0 failed
2016-02-01T08:13:05000Z|GEOMETRY|OUT OF RANGE|https://thredds.aodn.org.au/thredds/dodsC/IMOS/SOOP/SOOP-SST/VMQ9273_Solander/2013/IMOS_SOOP-SST_ST_20131231T115900Z_VMQ9273_FV01_C-20140101T005515Z.nc|-9999.0|-9999.0|LATITUDE.compareTo(context.latMin) >= 0 failed|LONGITUDE.compareTo(context.lonMin) >= 0 failed
2016-02-01T08:13:08000Z|GEOMETRY|OUT OF RANGE|https://thredds.aodn.org.au/thredds/dodsC/IMOS/SOOP/SOOP-SST/VMQ9273_Solander/2013/IMOS_SOOP-SST_ST_20131230T235800Z_VMQ9273_FV01_C-20131231T005523Z.nc|-9999.0|-9999.0|LATITUDE.compareTo(context.latMin) >= 0 failed|LONGITUDE.compareTo(context.lonMin) >= 0 failed
2016-02-01T08:13:10000Z|GEOMETRY|OUT OF RANGE|https://thredds.aodn.org.au/thredds/dodsC/IMOS/SOOP/SOOP-SST/VMQ9273_Solander/2013/IMOS_SOOP-SST_ST_20131229T235800Z_VMQ9273_FV01_C-20131230T005523Z.nc|-9999.0|-9999.0|LATITUDE.compareTo(context.latMin) >= 0 failed|LONGITUDE.compareTo(context.lonMin) >= 0 failed
2016-02-01T08:13:12000Z|GEOMETRY|OUT OF RANGE|https://thredds.aodn.org.au/thredds/dodsC/IMOS/SOOP/SOOP-SST/VMQ9273_Solander/2013/IMOS_SOOP-SST_ST_20131228T235800Z_VMQ9273_FV01_C-20131229T005525Z.nc|-9999.0|-9999.0|LATITUDE.compareTo(context.latMin) >= 0 failed|LONGITUDE.compareTo(context.lonMin) >= 0 failed
2016-02-01T08:13:15000Z|GEOMETRY|OUT OF RANGE|https://thredds.aodn.org.au/thredds/dodsC/IMOS/SOOP/SOOP-SST/VMQ9273_Solander/2013/IMOS_SOOP-SST_ST_20131227T235800Z_VMQ9273_FV01_C-20131228T005523Z.nc|-9999.0|-9999.0|LATITUDE.compareTo(context.latMin) >= 0 failed|LONGITUDE.compareTo(context.lonMin) >= 0 failed
2016-02-01T08:14:54000Z|GEOMETRY|OUT OF RANGE|https://thredds.aodn.org.au/thredds/dodsC/IMOS/SOOP/SOOP-SST/VMQ9273_Solander/2014/IMOS_SOOP-SST_ST_20140115T235800Z_VMQ9273_FV01_C-20140116T005535Z.nc|-9999.0|-9999.0|LATITUDE.compareTo(context.latMin) >= 0 failed|LONGITUDE.compareTo(context.lonMin) >= 0 failed
danfruehauf commented 8 years ago

Generally, I'd like those kind of harvesters to be decommissioned. That is because they crawl the whole thredds catalog and it is extremely inefficient and wasteful.

smancini commented 7 years ago

This harvester is now decommissioned. I will open another issue to investigate why some of the netCDF files do not contain any valid Latitude/Longitude.