search

counterdata-network / story-processor

Story discovery engine for the Counterdata Network. Grabs relevant stories from various APIs, runs them against bespoke classifier models, post results to a central server.
Apache License 2.0
0 stars 2 forks source link

Refactor Wayback to not use Prefect. #26

Closed adityagurnani22 closed 1 year ago

adityagurnani22 commented 1 year ago

Refactored Wayback to not use Prefect. In my system when I run it locally it takes a long time to run and in the end, I am facing an issue with the message queue function like I mentioned but I think that's something I am facing locally apart from that code runs properly like the newscatcher file. #23 #20

rahulbot commented 1 year ago

Superceeded by #28, which includes these changes and others from the updated newswatcher refactoring.