Chunking for download jobs in query jobs for DISP-S1 is done differently between historical mode vs the other modes. In historical mode, one chunk must contain all batch_ids of the frame because PGE expects them all at once and query is always performed one frame at a time. In forward/reprocessing modes more than one frame can be process at once and we need to group all batch_ids per acquisition time window per frame... and then add k granule batch_ids. It's a bit complicated.
While I was working on forward processing for chunking I broke historical processing chunking. This need to be fixed ASAP.
What did you expect?
n/a
Reproducible steps
1.
2.
3.
...
Environment
- Version of this software [e.g. vX.Y.Z]
- Operating System: [e.g. MacOSX with Docker Desktop vX.Y]
...
Checked for duplicates
Yes - I've already checked
Describe the bug
Chunking for download jobs in query jobs for DISP-S1 is done differently between historical mode vs the other modes. In historical mode, one chunk must contain all batch_ids of the frame because PGE expects them all at once and query is always performed one frame at a time. In forward/reprocessing modes more than one frame can be process at once and we need to group all batch_ids per acquisition time window per frame... and then add k granule batch_ids. It's a bit complicated.
While I was working on forward processing for chunking I broke historical processing chunking. This need to be fixed ASAP.
What did you expect?
n/a
Reproducible steps
Environment