BlueBrain / nexus

Blue Brain Nexus - A knowledge graph for data-driven science
https://bluebrainnexus.io/
Apache License 2.0
278 stars 74 forks source link

Unable to restart the projection of a composite view #4057

Open olivergrabinski opened 1 year ago

olivergrabinski commented 1 year ago

Using DELETE /v1/views/{org_label}/{project_label}/{view_id}/projections/{projection_id}/offset endpoint does not seem to be reflected in the statistics.

After deleting the projection offset, here is an example of what's shown in the Delta logs:

2023-07-10 13:01:09 INFO  c.e.b.n.d.p.c.p.CompositeProjections - Scheduling a FullRebuild from composite view https://bluebrain.github.io/nexus/vocabulary/searchView in project bbp-users/oliver
2023-07-10 13:01:12 INFO  c.e.b.n.d.p.c.p.CompositeProjections - Acknowledging FullRebuild for composite view bbp-users/oliver/https://bluebrain.github.io/nexus/vocabulary/searchView
2023-07-10 13:01:12 INFO  c.e.b.n.d.p.c.i.CompositeViewDef - Starting composite view 'bbp-users/oliver/https://bluebrain.github.io/nexus/vocabulary/searchView' with offset CompositeProgress(Map((https://bluebrain.github.io/nexus/vocabulary/searchSource,Main) -> At(280853)),Map(CompositeBranch(https://bluebrain.github.io/nexus/vocabulary/searchSource,https://bluebrain.github.io/nexus/vocabulary/searchProjection,Main) -> ProjectionProgress(At(280853),2023-07-10T09:16:57.864Z,68,67,0))).

Despite these logs, there does not seem to be anything reindexed in ES.

To reproduce:

  1. Check the ` usingGET /v1/views/{org_label}/{project_label}/{view_id}/projections/{projection_id}/statistics`
  2. Delete the projection offset using DELETE /v1/views/{org_label}/{project_label}/{view_id}/projections/{projection_id}/offset
  3. After a minute, check the statistic as in point 1 again. The value lastProcessedEventDateTime will be unchanged.
shinyhappydan commented 1 year ago

This now works because of the rebuild strategy being enabled

This ticket will be moved to the backlog because it's better to wait for other composite view tasks to be complete before looking at it again

There is a "leap" problem that still needs to be fixed, Simon knows about this