cgi-estonia-space / ALUs

GPU accelerated earth observation data processors
https://twitter.com/spacest372
GNU General Public License v3.0
23 stars 3 forks source link

Merge gaps between subswaths for specific calibration routine data #18

Closed kautlenbachs closed 1 year ago

kautlenbachs commented 1 year ago

Scene in question - S1A_IW_SLC__1SDV_20210722T005537_20210722T005604_038883_049695_2E58.SAFE

Image

kautlenbachs commented 1 year ago

Not present in SNAP. Present when no AOI

kautlenbachs commented 1 year ago

This happens during the merge. One of the sections zoomed out (between IW2 and IW3)

Image

Debursted IW2 result

Image

Debursted IW3 result

Image

kautlenbachs commented 1 year ago

Same occurs on a scene with the same coverage - S1A_IW_SLC__1SDV_20210710T005537_20210710T005604_038708_049158_B74A

kautlenbachs commented 1 year ago

Same happens for coherence

Image

kautlenbachs commented 1 year ago

No present when calibrating IW2 and IW3 AOI only.

Image

kautlenbachs commented 1 year ago

Also present for perito moreno glacier scene

Image

kautlenbachs commented 1 year ago

// TODO: add parallel_unsequenced_policy if minimal supported gcc version is changed to 9.1+ (Ubuntu 21.04 already uses 10+) topsar_merge.cc:134

kautlenbachs commented 1 year ago

Error happens when data is read from source (tile). Here can be seen a source read corrected by number of zeroes detected on a line after initial/original read (second read is done where offset is taken by number of zeroes detected - thats the initial offset/bug that is error). This is done in the bottom tile where data is fetched from a center subswath only. When read from both, a skewed pattern, where data read is not a rectangular but a parallelogram (seen in the middle upwards). image

kautlenbachs commented 1 year ago

It is not write error, as can be seen below. All the tiles/data that is error initially is now filled with static values and they are correctly written in the merged result Screenshot from 2023-02-16 10-02-46

kautlenbachs commented 1 year ago

All the tiles with error written into separate dataset:

Image

kautlenbachs commented 1 year ago

Does also happen when about 3-4 bursts are selected when specifying AOI -

Image

kautlenbachs commented 1 year ago

Source of the error is the case where source rectangle requests more data than there is in dataset.

Image

But it is hard to tell the outer tile. It can detect that buffer sizes do not match, but it does not know which is off, either the width or height.

Image

kautlenbachs commented 1 year ago

There was a broken golden image for end to end tests using maharashtra scene (S1A_IW_SLC__1SDV_20210722T005537_20210722T005604_038883_049695_2E58). rel diff

Image

section of the originating scene

Image

Other tests' golden ones did not need modification, hence current changes did not introduce any pixel offsets.