search

aodn / content

Tracks AODN Portal content and configuration issues
0 stars 0 forks source link

talend aodn_imas_fluorometry in error #420

Open ggalibert opened 5 years ago

ggalibert commented 5 years ago

Talend harvester aodn_imas_fluorometry is highlighted by Nagios to have output errors. Who is responsible for this harvester and what can we do about it for Nagios to be happy?

ggalibert commented 5 years ago

Xavier did the work on that one in 2016. @smancini who is the contact at IMAS for this? Emma Flukes? Need to check first that running this harvester is still relevant.

atkinsn commented 5 years ago

Yes its Emma @ggalibert

lbesnard commented 3 years ago

still the case. what is this harvester about?

atkinsn commented 3 years ago

We set this data up initially, and then handed the metadata to IMAS, but we still needed to manage the data in our Geoserver. https://metadata.imas.utas.edu.au/geonetwork/srv/eng/catalog.search#/metadata/fc64fc7b-29b0-4607-9527-899dfa991d68

lbesnard commented 3 years ago

The service seems to be running successfully. See the trend here for the last year

https://nagios.aodn.org.au/cgi-bin/nagios3/trends.cgi?t1=1627874943&t2=1628479743&host=10-aws-syd.emii.org.au&service=talend+aodn_imas_fluorometry&assumeinitialstates=yes&assumestateretention=yes&assumestatesduringnotrunning=yes&includesoftstates=no&initialassumedhoststate=0&initialassumedservicestate=0&backtrack=4&timeperiod=thisyear&zoom=4

however in this page, there is apparently a talend issue https://nagios.aodn.org.au/cgi-bin/nagios3/status.cgi?host=aggregated-monitors-pseudo-host

This harvester doesn't have a cron job to run every n days. It was a once off!

The data it is linked to is on the IMAS server: https://thredds.imas.utas.edu.au/thredds/catalog/IMAS/AMcMinn_FRRF_l_Astrolabe/catalog.html

which is linked to the data in our DB:

select url from aodn_imas_fluorometry.indexed_file  order by url
+------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| url                                                                                                                                                              |
|------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| http://thredds.imas.utas.edu.au/thredds/dodsC/IMAS/AMcMinn_FRRF_l_Astrolabe/2002/FRRF_TSB_20021228T202405Z_FHZI_FV01_fluorometry-R22002s_END-20030102T225001Z.nc |
| http://thredds.imas.utas.edu.au/thredds/dodsC/IMAS/AMcMinn_FRRF_l_Astrolabe/2003/FRRF_TSB_20030122T115618Z_FHZI_FV01_fluorometry-R22002n_END-20030127T090848Z.nc |
| http://thredds.imas.utas.edu.au/thredds/dodsC/IMAS/AMcMinn_FRRF_l_Astrolabe/2003/FRRF_TSB_20030219T073411Z_FHZI_FV01_fluorometry-R42002s_END-20030224T102200Z.nc |
| http://thredds.imas.utas.edu.au/thredds/dodsC/IMAS/AMcMinn_FRRF_l_Astrolabe/2003/FRRF_TSB_20030227T235935Z_FHZI_FV01_fluorometry-R42002n_END-20030304T173900Z.nc |
| http://thredds.imas.utas.edu.au/thredds/dodsC/IMAS/AMcMinn_FRRF_l_Astrolabe/2003/FRRF_TSB_20031021T080702Z_FHZI_FV01_fluorometry-R02003s_END-20031026T230931Z.nc |
| http://thredds.imas.utas.edu.au/thredds/dodsC/IMAS/AMcMinn_FRRF_l_Astrolabe/2003/FRRF_TSB_20031104T125959Z_FHZI_FV01_fluorometry-R02003n_END-20031110T210125Z.nc |
| http://thredds.imas.utas.edu.au/thredds/dodsC/IMAS/AMcMinn_FRRF_l_Astrolabe/2003/FRRF_TSB_20031205T232327Z_FHZI_FV01_fluorometry-R22003s_END-20031211T110908Z.nc |
| http://thredds.imas.utas.edu.au/thredds/dodsC/IMAS/AMcMinn_FRRF_l_Astrolabe/2003/FRRF_TSB_20031226T131535Z_FHZI_FV01_fluorometry-R22003n_END-20040101T032117Z.nc |
| http://thredds.imas.utas.edu.au/thredds/dodsC/IMAS/AMcMinn_FRRF_l_Astrolabe/2004/FRRF_TSB_20040218T095941Z_FHZI_FV01_fluorometry-R42003s_END-20040224T045650Z.nc |
| http://thredds.imas.utas.edu.au/thredds/dodsC/IMAS/AMcMinn_FRRF_l_Astrolabe/2004/FRRF_TSB_20040228T074910Z_FHZI_FV01_fluorometry-R42003n_END-20040304T091848Z.nc |
| http://thredds.imas.utas.edu.au/thredds/dodsC/IMAS/AMcMinn_FRRF_l_Astrolabe/2004/FRRF_TSB_20040411T062304Z_FHZI_FV01_fluorometry-R02004n_END-20040811T073103Z.nc |
| http://thredds.imas.utas.edu.au/thredds/dodsC/IMAS/AMcMinn_FRRF_l_Astrolabe/2004/FRRF_TSB_20041019T121518Z_FHZI_FV01_fluorometry-R02004s_END-20041024T071217Z.nc |
| http://thredds.imas.utas.edu.au/thredds/dodsC/IMAS/AMcMinn_FRRF_l_Astrolabe/2004/FRRF_TSB_20041230T094900Z_FHZI_FV01_fluorometry-R22004s_END-20050104T125900Z.nc |
| http://thredds.imas.utas.edu.au/thredds/dodsC/IMAS/AMcMinn_FRRF_l_Astrolabe/2005/FRRF_TSB_20050122T045500Z_FHZI_FV01_fluorometry-R22004n_END-20050127T091800Z.nc |
| http://thredds.imas.utas.edu.au/thredds/dodsC/IMAS/AMcMinn_FRRF_l_Astrolabe/2005/FRRF_TSB_20050218T122252Z_FHZI_FV01_fluorometry-R42004s_END-20050223T223011Z.nc |
| http://thredds.imas.utas.edu.au/thredds/dodsC/IMAS/AMcMinn_FRRF_l_Astrolabe/2005/FRRF_TSB_20050226T041013Z_FHZI_FV01_fluorometry-R42004n_END-20050303T194051Z.nc |
| http://thredds.imas.utas.edu.au/thredds/dodsC/IMAS/AMcMinn_FRRF_l_Astrolabe/2005/FRRF_TSB_20051018T130208Z_FHZI_FV01_fluorometry-R02005s_END-20051023T031828Z.nc |
| http://thredds.imas.utas.edu.au/thredds/dodsC/IMAS/AMcMinn_FRRF_l_Astrolabe/2005/FRRF_TSB_20051104T001925Z_FHZI_FV01_fluorometry-R02005n_END-20051108T084203Z.nc |
| http://thredds.imas.utas.edu.au/thredds/dodsC/IMAS/AMcMinn_FRRF_l_Astrolabe/2006/FRRF_TSB_20061022T000044Z_FHZI_FV01_fluorometry-R02006s_END-20061025T060459Z.nc |
| http://thredds.imas.utas.edu.au/thredds/dodsC/IMAS/AMcMinn_FRRF_l_Astrolabe/2007/FRRF_TSB_20070114T070947Z_FHZI_FV01_fluorometry-R22006s_END-20070119T090447Z.nc |
| http://thredds.imas.utas.edu.au/thredds/dodsC/IMAS/AMcMinn_FRRF_l_Astrolabe/2007/FRRF_TSB_20070210T072243Z_FHZI_FV01_fluorometry-R22006n_END-20070215T014657Z.nc |
| http://thredds.imas.utas.edu.au/thredds/dodsC/IMAS/AMcMinn_FRRF_l_Astrolabe/2007/FRRF_TSB_20070218T021342Z_FHZI_FV01_fluorometry-R42006s_END-20070223T035556Z.nc |
| http://thredds.imas.utas.edu.au/thredds/dodsC/IMAS/AMcMinn_FRRF_l_Astrolabe/2007/FRRF_TSB_20070227T061449Z_FHZI_FV01_fluorometry-R42006n_END-20070304T200225Z.nc |
| http://thredds.imas.utas.edu.au/thredds/dodsC/IMAS/AMcMinn_FRRF_l_Astrolabe/2007/FRRF_TSB_20071028T034554Z_FHZI_FV01_fluorometry-R02007s_END-20071101T101208Z.nc |
| http://thredds.imas.utas.edu.au/thredds/dodsC/IMAS/AMcMinn_FRRF_l_Astrolabe/2007/FRRF_TSB_20071116T033405Z_FHZI_FV01_fluorometry-R02007n_END-20071120T120220Z.nc |
| http://thredds.imas.utas.edu.au/thredds/dodsC/IMAS/AMcMinn_FRRF_l_Astrolabe/2007/FRRF_TSB_20071231T050806Z_FHZI_FV01_fluorometry-R22007s_END-20080105T035951Z.nc |
| http://thredds.imas.utas.edu.au/thredds/dodsC/IMAS/AMcMinn_FRRF_l_Astrolabe/2008/FRRF_TSB_20080122T081403Z_FHZI_FV01_fluorometry-R22007n_END-20080127T013333Z.nc |
| http://thredds.imas.utas.edu.au/thredds/dodsC/IMAS/AMcMinn_FRRF_l_Astrolabe/2008/FRRF_TSB_20080219T000051Z_FHZI_FV01_fluorometry-R42007s_END-20080219T182351Z.nc |
| http://thredds.imas.utas.edu.au/thredds/dodsC/IMAS/AMcMinn_FRRF_l_Astrolabe/2008/FRRF_TSB_20080227T053110Z_FHZI_FV01_fluorometry-R42007n_END-20080302T173754Z.nc |
| http://thredds.imas.utas.edu.au/thredds/dodsC/IMAS/AMcMinn_FRRF_l_Astrolabe/2008/FRRF_TSB_20081022T000034Z_FHZI_FV01_fluorometry-R02008s_END-20081027T225417Z.nc |
| http://thredds.imas.utas.edu.au/thredds/dodsC/IMAS/AMcMinn_FRRF_l_Astrolabe/2008/FRRF_TSB_20081104T220947Z_FHZI_FV01_fluorometry-R02008n_END-20081111T194816Z.nc |
| http://thredds.imas.utas.edu.au/thredds/dodsC/IMAS/AMcMinn_FRRF_l_Astrolabe/2009/FRRF_TSB_20091021T050932Z_FHZI_FV01_fluorometry-R02009s_END-20091025T115916Z.nc |
| http://thredds.imas.utas.edu.au/thredds/dodsC/IMAS/AMcMinn_FRRF_l_Astrolabe/2009/FRRF_TSB_20091111T211528Z_FHZI_FV01_fluorometry-R02009n_END-20091116T013412Z.nc |
+------------------------------------------------------------------------------------------------------------------------------------------------------------------+

I'm going to put a PR to simply ignore this job in nagios since everything seems to be correct. There's no problem if you can't see it, that's my opinion for old issues!

lbesnard commented 3 years ago

FYI @ggalibert

leonardolaiolo commented 3 years ago

@lbesnard I think this can be closed as PR is merged?

lbesnard commented 3 years ago

depends if its fixed. will check tomorrow

ggalibert commented 2 years ago

@lbesnard has this been fixed?