ahmia / ahmia-index

Ahmia's elasticsearch index
BSD 3-Clause "New" or "Revised" License
50 stars 31 forks source link

Change the way index aliases are updated #6

Closed chamalis closed 5 years ago

chamalis commented 5 years ago

Currently the cron job that handles the updates of latest-tor and latest-i2p:

 "10 04 16 * * cd /usr/local/home/juha/ahmia-index && python point_to_indexes.py > ./change_alias.log 2>&1"

is executed every 16th of month.

That means that the data of the first 15 days of each month will be unavailable during that period. One easy way to fix this is to add new index at 1st of month and remove the old one (2 months older) at 16th.

That increases the maximum number of indexed data kept online to 2.5 months, but it's worth the effort.