NLeSC / team-atlas

1 stars 0 forks source link

Data retiling #185

Closed meiertgrootes closed 3 years ago

meiertgrootes commented 3 years ago

As team we need to be able to retile a Geotiff to a specified regular size subtile grid. This in order to feed images to the NN classifier.

rogerkuou commented 3 years ago

Reproject to a local system can be down via specifying the dst_crs as a Proj.4 string. Here is an example tutorial on doing this via pyproj. rioxarray also uses pyproj to do reprojection.

rogerkuou commented 3 years ago

We did several investigation based on this. The retiling method is in general based on how we want to do shuffling. If we do not aim at shuffling all windows for all tiles, we can load several (i.e. as many as memory allows) tiles in the memory, retile them to windows, and shuffle these windows. As shown in Francesco's Notebook Otherwise if shuffling for all windows is required, we can make a window list first and shuffle those. like here