TREEcg / event-stream-client

Deprecated! Use the rdf-connect/ldes-client instead
https://github.com/rdf-connect/ldes-client
Other
14 stars 9 forks source link

Continuously export state #68

Open julianrojas87 opened 1 year ago

julianrojas87 commented 1 year ago

Currently the State is can only be exported on demand after pausing the client, which may cause that long running processes that are unexpectedly interrupted get fully lost.

We can make the client to optionally write its state to disk after each processed state, making that at worst case, only the latest page has to be re-processed in case of failure.