boto3 updates - Githubissues

impresso / impresso-pycommons

Python module with bits of code (objects, functions) highly reusable within impresso.

http://impresso-pycommons.rtfd.io/

GNU Affero General Public License v3.0

3 stars 3 forks source link

Open e-maud opened 6 years ago

e-maud commented 6 years ago

[ ] update get_bucket to boto3 and get read of boto
[ ] change signature of get_s3_versions so that the first param is an instantiated bucket already.
[x] update smart_open library
[x] update boto3 library
[x] detect number of workers automatically for s3_iter_bucket function (default is 16)

e-maud commented 6 years ago

The last release of smart_open library, fron which we get the s3_iter_bucket still works with boto.

The last version of the files on github of this library use boto3.

=> we wait until the release of smart open with boto3, and live with the 2 boto for now.