Since the PR #75 hasn't had any updates for some time, I am making this one with changes made by me and @motivationalreposter, I suggest @wkentaro close the older PR in favor of this one that is preserving @motivationalreposter commits and contains an implementation that is up-to-date and working.
duplicated of #90, since master branch changed to main.
TODO:
[x] Check to see if it is still working 0.o, it is :)
[x] Raise exception on folder with >=50 files, disable raising this exception when flag remaining_ok=True
[x] Add tests for remaining_ok
[x] Check hashsum of files downloaded in integration tests
[x] Add in the docs and --help about the 50 files limitation
[x] For intermediary data objects use ~dataclasses~ custom class instances instead of dicts
[x] Add unit tests for parser
Possible improvements:
Compare each file update time so that it only downloads the necessary files
Threaded/async files download
What this PR adds
This PR adds support for Gdrive folders by parsing the js in the main page and getting it's required files IDs, as well as adding proper CI testing in a gdrive folder with some CC0 license images.
So,this PR contains as well (written by @motivationalreposter in the PR #75) :
'
This commit solves the problem of downloading entire Google Drive folders, which has been an issue for quite a while (#62, #65).
This solution uses Beautiful Soup to get the Githubissues.
Githubissues is a development platform for aggregating issues.
Disclaimer
Since the PR #75 hasn't had any updates for some time, I am making this one with changes made by me and @motivationalreposter, I suggest @wkentaro close the older PR in favor of this one that is preserving @motivationalreposter commits and contains an implementation that is up-to-date and working.
duplicated of #90, since master branch changed to main.
TODO:
Possible improvements:
What this PR adds
This PR adds support for Gdrive folders by parsing the js in the main page and getting it's required files IDs, as well as adding proper CI testing in a gdrive folder with some CC0 license images.
So,this PR contains as well (written by @motivationalreposter in the PR #75) :
' This commit solves the problem of downloading entire Google Drive folders, which has been an issue for quite a while (#62, #65).
This solution uses Beautiful Soup to get the Githubissues.