bellingcat / auto-archiver

Automatically archive links to videos, images, and social media content from Google Sheets (and more).
https://pypi.org/project/auto-archiver/
MIT License
578 stars 60 forks source link

Folders and Google Drive #35

Closed djhmateer closed 2 years ago

djhmateer commented 2 years ago

Implementations of:

This was coded to be as simple as I could make it. There is a lot of room for refactoring!

A big change was the Google Drive works on ID's, not on relative file paths and names. Also GD doesn't allow you to serve a static html page, which caused the thumbnails page to break. This was not a problem for us.

As far as my testing has gone, I believe this to all work as expected, and it shouldn't break any of your sheets. For example the new File Number column is not required.

djhmateer commented 2 years ago

And apologies for such a beast of a PR.

msramalho commented 2 years ago

Hi @djhmateer I've refactored the whole code a bit since the filenumber config provoked a lot of changes in a not-easy to maintain way. I will merge it to dev branch now, then will work my other PR into it, do further cleanups and merge to master. When I merge to master I will explain how the filenumber -> subfolder changes works, but the idea is that any storage can use it if available, and if it is missing then GDarchiver will default to a folder default.

Thank you very much for figuring out how to do this.

djhmateer commented 2 years ago

Hi @msramalho many thanks for merging in to dev and for refactoring. I look forward to seeing other changes and merge up into master. Let me know if I can help.