My change in #401 to filter out scrapers with autodag set to false caused issues.
Setting autodag = False for TableauDashboard also set it to false for all of its subclasses, meaning none of them (about 12 in total, including the North Carolina scraper) were being included in the MainFlows 😬.
I'm sorry about this, I'm not sure how I didn't realize this at the time, but I'll do more testing before making similar changes in the future. Fortunately, this didn't affect any scrapers that we are currently using, but it does mean that we lost ~10 days of history for the scrapers that were filtered out. This reverts the filtering to the old method (explicitly removing the scrapers during the collection).
My change in #401 to filter out scrapers with
autodagset to false caused issues.Setting
autodag = FalseforTableauDashboardalso set it to false for all of its subclasses, meaning none of them (about 12 in total, including the North Carolina scraper) were being included in theMainFlows 😬.I'm sorry about this, I'm not sure how I didn't realize this at the time, but I'll do more testing before making similar changes in the future. Fortunately, this didn't affect any scrapers that we are currently using, but it does mean that we lost ~10 days of history for the scrapers that were filtered out. This reverts the filtering to the old method (explicitly removing the scrapers during the collection).