User assertions are disappearing from SOLR index

[nickdos]

@elywallis reported this a few weeks back. When a user adds an annotation (assertion) on a record that triggers that record to be removed by the DQ filters (e.g. location issue), the SOLR index is updated immediately and the record disappears from the default "ALA General" DQ profile results set, as expected.

The problem is when a user re-runs the same query as above, a few days later, the same record re-appears in the result set. The record still has the annotation on it but it appears the SOLR index has lost the assertion status. This seems to happen after a full re-index has run over night.

@djtfmartin thought it was due to a missing Jenkins task not being run as part of the full indexing job. @peggynewman thinks this is not the case (not sure if that means job is now included but issue is still happening or that the cause is somewhere else).

[nickdos]

Testing this again now.

https://biocache.ala.org.au/occurrences/search?q=collector_text%3Aremedios orignally returned 23 of 31 records.

Then I added an annotation to this record, reducing count to be 22 of 31 records.

Retest next week so see how many records are being displayed.

[nickdos]

https://biocache.ala.org.au/occurrences/search?q=collector_text%3Aremedios

Now shows 29 of 31 records.

So issue is still unresolved.

[djtfmartin]

Issue moved to AtlasOfLivingAustralia/biocache-service #704 via ZenHub