search

TerriaJS / nationalmap

Australia's NationalMap
https://nationalmap.gov.au
122 stars 45 forks source link

Check 'search' not showing existing datasets in list of results #1217

Closed AnaBelgun closed 1 year ago

AnaBelgun commented 1 year ago

Investigation on why some datasets do not show up in search results. Check Cadastre Address (LGATE-002). When adding that dataset from Western Australia - State government - Landgate subgroup it performs as expected.

staffordsmith83 commented 1 year ago

UPDATE 2 August 2023:

Nick used to update the index to fix this issue?

na9da commented 1 year ago

@AnaBelgun - the specific example of LGATE datasets you gave failed due to a transient error (timeout during crawling). It fixed itself when I re-ran the indexer just now.

A longer term solution would be to look at merging the indexes from past 3 days to smooth over transient errors so that an item that failed due to timeout stays in the index for 3 consecutive days before it gets removed. I could have a look at implementing that.

na9da commented 1 year ago

Have created a new ticket for investigating on making the index resistant to transient errors.