error cog processing - Githubissues

JesJehle commented 3 weeks ago

[ERROR]: Error gdal_translate: Command '['gdal_translate', '/tmp/cog_processing_9fro73q4/a2a00c82-1eeb-4726-a0fd-c7710872e45e_TDOP_2015_143_jpg85_btif_mosaic.tif', '/tmp/cog_processing_9fro73q4/a2a00c82-1eeb-4726-a0fd-c7710872e45e_TDOP_2015_143_jpg85_btif_mosaic_cog_jpeg_ts_web-optimized_q75.tif', '-of', 'COG', '-co', 'COMPRESS=JPEG', '-co', 'BLOCKSIZE=512', '-co', 'QUALITY=75', '-co', 'OVERVIEW_COMPRESS=JPEG', '-co', 'TILING_SCHEME=GoogleMapsCompatible', '-co', 'OVERVIEWS=IGNORE_EXISTING', '--config', 'GDAL_TIFF_INTERNAL_MASK', 'TRUE', '--config', 'GDAL_GTIFF_SRS_SOURCE', 'EPSG']' returned non-zero exit status 1.
[INFO]: Retrying setting EPSG:3857
[ERROR]: Error running gdal_translate with EPSG:3857: Command '['gdal_translate', '/tmp/cog_processing_9fro73q4/a2a00c82-1eeb-4726-a0fd-c7710872e45e_TDOP_2015_143_jpg85_btif_mosaic.tif', '/tmp/cog_processing_9fro73q4/a2a00c82-1eeb-4726-a0fd-c7710872e45e_TDOP_2015_143_jpg85_btif_mosaic_cog_jpeg_ts_web-optimized_q75.tif', '-of', 'COG', '-co', 'COMPRESS=JPEG', '-co', 'BLOCKSIZE=512', '-co', 'QUALITY=75', '-co', 'OVERVIEW_COMPRESS=JPEG', '-co', 'TILING_SCHEME=GoogleMapsCompatible', '-co', 'OVERVIEWS=IGNORE_EXISTING', '--config', 'GDAL_TIFF_INTERNAL_MASK', 'TRUE', '--config', 'GDAL_GTIFF_SRS_SOURCE', 'EPSG', '-a_srs', 'EPSG:3857']' returned non-zero exit status 1.
[ERROR]: PROCESSOR error processing task 328: Command '['gdal_translate', '/tmp/cog_processing_9fro73q4/a2a00c82-1eeb-4726-a0fd-c7710872e45e_TDOP_2015_143_jpg85_btif_mosaic.tif', '/tmp/cog_processing_9fro73q4/a2a00c82-1eeb-4726-a0fd-c7710872e45e_TDOP_2015_143_jpg85_btif_mosaic_cog_jpeg_ts_web-optimized_q75.tif', '-of', 'COG', '-co', 'COMPRESS=JPEG', '-co', 'BLOCKSIZE=512', '-co', 'QUALITY=75', '-co', 'OVERVIEW_COMPRESS=JPEG', '-co', 'TILING_SCHEME=GoogleMapsCompatible', '-co', 'OVERVIEWS=IGNORE_EXISTING', '--config', 'GDAL_TIFF_INTERNAL_MASK', 'TRUE', '--config', 'GDAL_GTIFF_SRS_SOURCE', 'EPSG', '-a_srs', 'EPSG:3857']' returned non-zero exit status 1.

This was the complete error: Much clearer now!

0.ERROR 1: TIFFAppendToStrip:Maximum TIFF file size exceeded. Use BIGTIFF=YES creation option.
ERROR 1: An error occurred while writing a dirty block from GDALRasterBand::IRasterIO
ERROR 1: TIFFAppendToStrip:Maximum TIFF file size exceeded. Use BIGTIFF=YES creation option.
ERROR 1: output.tif.warped.tif.tmp: WriteEncodedTile/Strip() failed.

JesJehle commented 3 weeks ago

debugging:

gdal_translate /Users/januschvajna-jehle/Downloads/janusch-transfer/blackforestnationalparktimeseries/TDOP_mosaic/TDOP_2015_143_jpg85_btif_mosaic.tif output.tif -of COG -co COMPRESS=JPEG -co BLOCKSIZE=512 -co QUALITY=75 -co OVERVIEW_COMPRESS=JPEG -co TILING_SCHEME=GoogleMapsCompatible -co OVERVIEWS=IGNORE_EXISTING --config GDAL_TIFF_INTERNAL_MASK TRUE --config GDAL_GTIFF_SRS_SOURCE EPSG

Driver: GTiff/GeoTIFF Files: /Users/januschvajna-jehle/Downloads/janusch-transfer/blackforestnationalparktimeseries/TDOP_mosaic/TDOP_2015_143_jpg85_btif_mosaic.tif Size is 190001, 295001 Coordinate System is: PROJCRS["ETRS89 / UTM zone 32N", BASEGEOGCRS["ETRS89", ENSEMBLE["European Terrestrial Reference System 1989 ensemble", MEMBER["European Terrestrial Reference Frame 1989"], MEMBER["European Terrestrial Reference Frame 1990"], MEMBER["European Terrestrial Reference Frame 1991"], MEMBER["European Terrestrial Reference Frame 1992"], MEMBER["European Terrestrial Reference Frame 1993"], MEMBER["European Terrestrial Reference Frame 1994"], MEMBER["European Terrestrial Reference Frame 1996"], MEMBER["European Terrestrial Reference Frame 1997"], MEMBER["European Terrestrial Reference Frame 2000"], MEMBER["European Terrestrial Reference Frame 2005"], MEMBER["European Terrestrial Reference Frame 2014"], ELLIPSOID["GRS 1980",6378137,298.257222101, LENGTHUNIT["metre",1]], ENSEMBLEACCURACY[0.1]], PRIMEM["Greenwich",0, ANGLEUNIT["degree",0.0174532925199433]], ID["EPSG",4258]], CONVERSION["UTM zone 32N", METHOD["Transverse Mercator", ID["EPSG",9807]], PARAMETER["Latitude of natural origin",0, ANGLEUNIT["degree",0.0174532925199433], ID["EPSG",8801]], PARAMETER["Longitude of natural origin",9, ANGLEUNIT["degree",0.0174532925199433], ID["EPSG",8802]], PARAMETER["Scale factor at natural origin",0.9996, SCALEUNIT["unity",1], ID["EPSG",8805]], PARAMETER["False easting",500000, LENGTHUNIT["metre",1], ID["EPSG",8806]], PARAMETER["False northing",0, LENGTHUNIT["metre",1], ID["EPSG",8807]]], CS[Cartesian,2], AXIS["(E)",east, ORDER[1], LENGTHUNIT["metre",1]], AXIS["(N)",north, ORDER[2], LENGTHUNIT["metre",1]], USAGE[ SCOPE["Engineering survey, topographic mapping."], AREA["Europe between 6°E and 12°E: Austria; Belgium; Denmark - onshore and offshore; Germany - onshore and offshore; Norway including - onshore and offshore; Spain - offshore."], BBOX[38.76,6,84.33,12.01]], ID["EPSG",25832]] Data axis to CRS axis mapping: 1,2 Origin = (436949.654129832866602,5396780.092095835134387) Pixel Size = (0.099960095948830,-0.099960095948830) Metadata: AREA_OR_POINT=Area Image Structure Metadata: COMPRESSION=YCbCr JPEG INTERLEAVE=PIXEL JPEGTABLESMODE=1 JPEG_QUALITY=85 SOURCE_COLOR_SPACE=YCbCr Corner Coordinates: Upper Left ( 436949.654, 5396780.092) ( 8d 8'33.92"E, 48d43'15.09"N) Lower Left ( 436949.654, 5367291.764) ( 8d 8'50.03"E, 48d27'20.17"N) Upper Right ( 455942.172, 5396780.092) ( 8d24' 3.47"E, 48d43'20.96"N) Lower Right ( 455942.172, 5367291.764) ( 8d24'14.73"E, 48d27'25.99"N) Center ( 446445.913, 5382035.928) ( 8d16'25.55"E, 48d35'20.82"N) Band 1 Block=256x256 Type=Byte, ColorInterp=Red NoData Value=0 Overviews: 95001x147501, 47501x73751, 23751x36876, 11876x18438, 5938x9219, 2969x4610 Band 2 Block=256x256 Type=Byte, ColorInterp=Green NoData Value=0 Overviews: 95001x147501, 47501x73751, 23751x36876, 11876x18438, 5938x9219, 2969x4610 Band 3 Block=256x256 Type=Byte, ColorInterp=Blue NoData Value=0 Overviews: 95001x147501, 47501x73751, 23751x36876, 11876x18438, 5938x9219, 2969x4610

JesJehle commented 3 weeks ago

https://kokoalberti.com/articles/geotiff-compression-optimization-guide/

JesJehle commented 3 weeks ago

gdal_translate \
  -co BIGTIFF=YES \
  /Users/januschvajna-jehle/data/deadwood-example-data/orthos/uavforsat_2017_CFB030_ortho.tif \
  output-overview-jpeg.tif \
  -ot Byte \
  -of COG \
  -co COMPRESS=JPEG \
  -co QUALITY=75 \
  -co OVERVIEW_COMPRESS=JPEG \
  -co OVERVIEW_QUALITY=75 \
  -co TILING_SCHEME=GoogleMapsCompatible \
  --config GDAL_NUM_THREADS ALL_CPUS \
  --config GDAL_CACHEMAX 24576

Deadwood-ai / deadwood-api

error cog processing #84