fed: Splitting at stream epoch level.

EIDA / mediatorws

EIDA NG Mediator/Federator web services

GNU General Public License v3.0

6 stars 6 forks source link

fed: Splitting at stream epoch level. #29

Closed damb closed 6 years ago

damb commented 6 years ago

The current splitting mechanism does not handle large requests for e.g. fdsnws-dataselect. Currently federator splitting is implemented by dividing the number of postline requests. However, for granular requests splitting must be implemented by means of splitting stream epochs regarding time constraint parameters.

damb commented 6 years ago

Implemented with 77cfb2a. Implemented for both fdsnws-dataselect and eidaws-wfcatalog. Closed.

Splitting and aligning for eidaws-wfcatalog (i.e. HTTP status code 413 handling) requires parsing and creating python objects from JSON (JSON objects do not need to preserve the order. (see: RFC-7159)).