Page S3 - Githubissues

wri / gfw-datapump

Nightly batch process to generate summary statistics for user AOIs

3 stars 2 forks source link

Page S3 #113

Closed jterry64 closed 1 year ago

jterry64 commented 1 year ago

Pull request checklist

Please check if your PR fulfills the following requirements:

[X] Make sure you are requesting to pull a topic/feature/bugfix branch (right side). Don't request your master!
[X] Make sure you are making a pull request against the develop branch (left side). Also you should start your branch off our develop.
[X] Check the commit's or even all commits' message styles matches our requested structure.
[X] Check your code additions will fail neither code linting checks nor unit test.

Pull request type

Please check the type of change your PR introduces:

[X] Bugfix
[ ] Feature
[ ] Code style update (formatting, renaming)
[ ] Refactoring (no functional changes, no api changes)
[ ] Build related changes
[ ] Documentation content changes
[ ] Other (please describe):

What is the current behavior?

ListBucket S3 call will get the first 1000 results from AWS.

What is the new behavior?

Read results from ListBucket using pagination to make sure we get all results.
Increase time limit for fire geotrellis job since the upload can take 6+ hours.

Does this introduce a breaking change?

[ ] Yes
[X] No