Clean up stale seen_listings entries

scottmconway / shopgoodwill-scripts

A collection of scripts for programmatically interacting with Shopgoodwill

GNU General Public License v3.0

51 stars 17 forks source link

Closed scottmconway closed 2 years ago

scottmconway commented 2 years ago

As of now, seen_listings will continue to grow indefinitely, for all queries issued to alert_on_new_query_results.py.

There are a few ways we could change this:

Change the seen_listings format to include the auctions' start times, and remove them after a user-defined time (probably a week or two)
Check each listings' validity after each execution, and remove stale items (network-intensive)