WIP: Archiving media, organization improvements - Githubissues

bellingcat / cisticola

Coordinates scrapers and interfaces with database

15 stars 0 forks source link

WIP: Archiving media, organization improvements #2

Closed loganwilliams closed 2 years ago

loganwilliams commented 2 years ago

Organization:

[x] Yield results rather than returning lists in get_posts
[ ] Modify BitchuteScraper to yield

Archiving media:

[x] Add a method for archiving arbitrary media
[x] Implement media archiving in TwitterScraper
[x] Implement media archiving in TelegramSnscrapeScraper
[ ] Implement media archiving in GettrScraper (partially done -- need to save the actual mp4 file)
[ ] Implement media archiving in BitchuteScraper