cryogars / ice-road-copters

MIT License
8 stars 1 forks source link

Improve final GeoTiff outputs #14

Open jomey opened 2 weeks ago

jomey commented 2 weeks ago

Couple of improvements can be made to the final output products:

shadoneel commented 2 weeks ago

Hey Joe - Just noticing that you are suggesting tiling - Maybe you are better at Tiling than me, but when we tried to tile in the past, the snow depth maps are filled with artifacts and its not easy to remove them. Do you know how to collar them, to get rid of edge issues?

Shad

On Mon, Jul 8, 2024 at 2:28 PM Joachim Meyer @.***> wrote:

Couple of improvements can be made to the final output products:

  • Use data compression to reduce file size, create overviews, and use all CPUs

-co TILED=YES -co COMPRESS=ZSTD -co PREDICTOR=2 -co BIGTIFF=IF_SAFER -co NUM_THREADS=ALL_CPUS -co SPARSE_OK=TRUE -co INTERLEAVE=BAND

— Reply to this email directly, view it on GitHub https://github.com/cryogars/ice-road-copters/issues/14, or unsubscribe https://github.com/notifications/unsubscribe-auth/AA22DJLSIVIFTJBT5P3O4ZTZLLZAFAVCNFSM6AAAAABKRQ3EMKVHI2DSMVQWIX3LMV43ASLTON2WKOZSGM4TMNJQHE4DOMQ . You are receiving this because you are subscribed to this thread.Message ID: @.***>

jomey commented 2 weeks ago

Do you know how to collar them, to get rid of edge issues?

The TILED=YES is something I always set for big raster files. That being said, I have yet to deal with ones that had many gaps. Probably something to investigate in this case or simply overkill for small areas.

GDAL does have sparse support, which again would need testing for this case if it helps with artifacts.

Hope I got this question right.

shadoneel commented 2 weeks ago

What i experienced in the past is that a DEM tiled product is excellent (e.g. Mores with 600 m relief) but as soon as you difference for snow depth (2 m relief) you can see the tile edges as artifacts.

Different than holes, but still a problem. Both Naheem and Tate have approaches for hole filling, not sure which is best, but both seem reasonable.

On Mon, Jul 8, 2024 at 3:36 PM Joachim Meyer @.***> wrote:

Do you know how to collar them, to get rid of edge issues?

The TILED=YES is something I always set for big raster files. That being said, I have yet to deal with ones that had many gaps. Probably something to investigate in this case or simply overkill for small areas.

GDAL does have sparse support https://gdal.org/drivers/raster/gtiff.html#sparse-files, which again would need testing for this case if it helps with artifacts.

Hope I got this question right.

— Reply to this email directly, view it on GitHub https://github.com/cryogars/ice-road-copters/issues/14#issuecomment-2215388650, or unsubscribe https://github.com/notifications/unsubscribe-auth/AA22DJPDC6B7IR2J5D4POILZLMA6ZAVCNFSM6AAAAABKRQ3EMKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEMJVGM4DQNRVGA . You are receiving this because you commented.Message ID: @.***>