aodn / nrmn-application

A web application for collation, validation, and storage of all data obtained during surveys conducted by the NRMN
GNU General Public License v3.0
4 stars 3 forks source link

UI not performing as expected - jobs not displaying in ingested (or staged) list after attempted ingest #1376

Open atcooper1 opened 3 months ago

atcooper1 commented 3 months ago

Ingested Job #675 on Friday at approx. 12:00pm, at 5:00pm server error msg was visible and the job was still ingesting. Monday morning and the UI is still displaying the ingesting screen and server busy error. Refreshed screen and re-logged in, the job has disappeared from the staged list but is also not present in the Ingested jobs list. A quick check reveals the observations seem to exist in the DB, however with no feedback from the UI, it's hard to check that all observations were ingested as expected.

Other recent UI issues include:

utas-raymondng commented 3 months ago

Hi Toni,

I have a quick check, for job 675 it is called "RLS QLD Cairns to TI combined 230908.xlsx", which appears in INGESTED.

image

image

regards Raymond

utas-raymondng commented 3 months ago

Meta data also shows correct record

image

atcooper1 commented 3 months ago

Thanks Raymond. Before closing this, it would be great to resolve the progressively longer ingest times (and server error messages) as this is significantly affecting workflow? Thanks

vfisaac commented 3 months ago

Hi Toni, We will create an internal backlog issue to look at possible improvements to the long ingest times. This work will most likely involve significant effort and major changes and as such we would be more comfortable undertaking this work when Bene is returned from leave to review and test any proposed changes to the ingest process. As such I would like to schedule this work for the following iteration ie. starting the 13th August.