Occasional Incomplete Index of Datasets

[hleckenb]

---

User Story in a table

As A	I Want	So that
< As a BC Data Catalogue Admin or data searcher>	< I want to be assured that all available datasets are indexed according to my security settings on a regular basis>	< so that I can locate the correct dataset needed; know that all available datasets are represented; be able to verify a dataset indexed correctly and test it.>

---

Test Case

ENV PROD, CAT, CAD Not occurring here.

TESTCASE This is occurring and different times of the data No pattern has been identified yet

Navigate to the Dataset Search result page: https://catalogue.data.gov.bc.ca/dataset EXPECTED The count should be over 4k The log indicates the count should be closer to if not actually 4927 (Jan 16 2019) if not logged in the count will be approx 2.8k

screen shot 2019-01-16 at 2 03 41 pm

ACTUAL The count is incorrect screen shot 2019-01-16 at 2 06 23 pm

NOTE According to logs the current number of documents (metadata records) is:

4927

[hleckenb]

@dkelsey Hey mate, sorry its a bit crap ... just making a place holder to address the indexing inconsistencies/issues. When you have a moment would you mind capturing the testcase so we can prioritize this piece of work please?

[dkelsey]

An Issue does exist in JIRA.

---

ENV

PROD, CAT, CAD Not occurring here.

TESTCASE

This is occurring and different times of the data No pattern has been identified yet

• Navigate to the Dataset Search result page: https://catalogue.data.gov.bc.ca/dataset

EXPECTED

• The count should be over 4k

The log indicates the count should be closer to if not actually 4927 (Jan 16 2019) if not logged in the count will be approx 2.8k

ACTUAL

• The count is incorrect

NOTE

According to logs the current number of documents (metadata records) is:

4927

[hleckenb]

@dkelsey feel free to edit straight to core ticket. Please ensure the work to be carried out clear according to the 2 JIRA tickets and this one.