SwissDataScienceCenter / renku-search

2 stars 0 forks source link

Switch redis streams for provisioning #183

Closed eikek closed 1 month ago

eikek commented 2 months ago

In the future, there will be a redis stream (or other type) that will be used to hold stream names to use for reading current data about renku entities.

Search must only use these streams to read and ingest data. Once the value changes, it means there is a complete new dataset and the index is outdated. Search must then re-index everything from the beginning of these streams.

eikek commented 1 month ago

On hold, as we decided to reuse the existing streams.

eikek commented 1 month ago

For the time being, we won't use new streams. This might come up later, then a new issue should be created.