SwissDataScienceCenter / renku-search

2 stars 0 forks source link

Recreate the index as a migration step #184

Closed eikek closed 1 month ago

eikek commented 2 months ago

When the solr schema is changed, it might require to recreate the index. This should be a part of teh schema migration. This means reading the redis streams from the beginning and building up the index again. After #183 this can be triggered from data services, but in this ticket the recreation of the index is required to run as a migration step in case it's needed. It doesn't always need to be a complete re-creation, since the redis stream is represented as a scala fs2.Stream, filtering can be done as part of the specific migration. For this issue to complete, there must be some nice to use API for creating these migration steps.