search

prestonpeterson / CI_RAE

Bot that scrapes user comments and profiles on Reddit.com and performs various analyses on the resulting data.
1 stars 0 forks source link

Bot will cause duplicates when restarting #2

Closed zbatoczki closed 8 years ago

zbatoczki commented 8 years ago

Pretty self-explanatory. Since resetting the script will clear the cache of comments that have already been processed, it would re-process comments. We might fix the issue once we get to the database stage.

prestonpeterson commented 8 years ago

As of commit 905db16e3f79e8a08fea7524adde3839e8f484ca this issue should be fixed. The bot will check all the replies of a comment to see if it authored any of them. Since it has a bad memory