developmentseed / chabud2023

Change detection for Burned area Delineation (ChaBuD) ECML/PKDD 2023 challenge
Other
5 stars 1 forks source link

:bento: Extra data and pre-batch shuffle on train datapipe #14

Closed weiji14 closed 1 year ago

weiji14 commented 1 year ago

What I am changing

How I did it

How you can test it

Related Issues

Note that the shuffling operation is slower than in-batch shuffling. There is a longer delay at the start as the image chips are added to the shuffle buffer, and each mini-batch is now processing about 2x slower (one iteration used to take ~1s, now it takes ~2s).