fake-name / xA-Scraper

69 stars 8 forks source link

reset-run-state individually #58

Closed God-damnit-all closed 4 years ago

God-damnit-all commented 4 years ago

Given multiprocessing is due to be scrapped from the code in favor of running the scrapers as individual processes, I think reset-run-state should allow for an optional parameter - the same parameters used for the fetch command. Naturally, this would reset the run state for just that site rather than all the run states.

I looked into doing this myself, I couldn't get arguments to pass from main to db_manage to the resetter correctly (mainly due to my inexperience with Python) and I figured I'd just post an issue since this sounds like it'd be trivial for someone who knew what they were doing.