search

counterdata-network / story-processor

Story discovery engine for the Counterdata Network. Grabs relevant stories from various APIs, runs them against bespoke classifier models, post results to a central server.
Apache License 2.0
0 stars 2 forks source link

remove google_alerts code and final prefect dependency #40

Closed rahulbot closed 1 year ago

rahulbot commented 1 year ago

Once #31 is done, we should remove the last vestiges of the prefect architecture by simply deleting the google_alerts code path and scripts. We originally created it for use with partner groups, but haven't used it in a year at least. We can't afford to maintain unused code so this task involves removing the associated scripts, removing last traces of prefect use, and removing any unused functions this creates in the tasks helper modules.

rahulbot commented 1 year ago

Note: also remove all the unneeded passing of logger around into helper functions, because with just one path in we won't need to pass it around.