Baseline 4.0 Offset Issue

Element84 / earth-search

Earth Search information and issue tracking

https://earth-search.aws.element84.com/v1

27 stars 2 forks source link

Baseline 4.0 Offset Issue #9

Open julianblue opened 1 year ago

julianblue commented 1 year ago

@matthewhanson ,

is there an update on this https://github.com/cirrus-geo/cirrus-earth-search/issues/26 ?

I am facing issues when processing sentinel data as there are cases when the scale supposedly was not applied (according to metadata) but actually seems to have been applied. --> causing negative values in some instances

matthewhanson commented 1 year ago

@julianblue are you looking at the earthsearch:boa_offset_applied property? Or at the raster:bands.offset property? It looks like the offset property may be incorrectly set to -0.1 even when it has been applied but I think the boa_offset_applied is the truth.

This has been fixed in our new pipeline which we will be switching to soon for new scenes and will be processing the new ESA produced scenes as they are made available.

gcaria commented 11 months ago

When reading the TIFs directly from the S3 bucket, is there a way to know whether the offset has been applied?

e.g. reading the data with rioxarray, would it be possible to rely on the add_offset attribute (see example below)?

jkeifer commented 9 months ago

@gcaria Unfortunately, the current COG files do not have the scale/offset written to them, so this is an unreliable indicator. This has also been fixed in the new pipeline.