search

NFDI4BIOIMAGE / search_engine

search engine for the NFDI4BIOIMAGE materials
BSD 3-Clause "New" or "Revised" License
1 stars 0 forks source link

Index should be auto update #24

Open SeverusYixin opened 3 weeks ago

SeverusYixin commented 3 weeks ago

Currently the index of the data source is only loaded again on re-run, it would be great if in the future, after the docker is deployed, he could update it regularly/in real time to check that new data has been added after the event.

possible:

Real-time updating:

using a watchdog-like file-monitoring library to monitor resource directories and automatically re-index files when changes are detected.

Scheduled Reindexing:

with the help of APScheduler, e.g. every 10 mins/1 h/1 d/... update it

haesleinhuepf commented 2 weeks ago

Maybe once a day is enough.