barnslig / torture

FTP search based on Go! and ElasticSearch for the 31. Chaos Communication Congress
MIT License
17 stars 6 forks source link

Check for file existence on re-crawling #18

Open barnslig opened 8 years ago

barnslig commented 8 years ago

It should somehow be possible to hide/remove files from the search index which do no longer exist. Maybe it is enough to update the timestamp of every entry which is found so we can just filter everything older than e.g. an hour.