dlr-eoc / prosEO

prosEO – A Processing System for Earth Observation Data
GNU General Public License v3.0
14 stars 1 forks source link

Data ingestion: Add feedback about ingestion progress to Storage Mgr/Ingestor/CLI #89

Open tangobravo62 opened 4 years ago

tangobravo62 commented 4 years ago

For the user a feedback on the upload progress for ingestions shall be given, since transactions over the whole chain CLI -> Ingestor -> Storage Manager -> Object Storage may take several minutes, e. g. when ingesting large product files (several 100 MB to several GB; observed 4-12 min for a 1.5 GB file).

A protocol shall be defined to communicate between clients and servers along the chain. All potentially long-running HTTP requests shall be changed to use the reactive Spring WebClient instead of the old (synchronous) RestTemplate.