rdf-connect / ldes-client

The TREE/LDES client to replicate and synchronize LDESs: the RDF Connect processor
https://rdf-connect.github.io/ldes-client/
6 stars 2 forks source link

Catch member errors #24

Closed ajuvercr closed 2 months ago

ajuvercr commented 3 months ago
pietercolpaert commented 3 months ago

The concurrent requests now also refetch concurrently, which of course then keeps resulting in problems:

pieter@pieter-Latitude-7430:~/Projects/LDES-client$ export DEBUG=*;ts-node bin/cli.ts https://marineregions.org/feed.ttl --retry-count 0
...
  fetch:retry Retry https://www.marineregions.org/feed.ttl?page=2023-10-02T11%3A00%3A00Z%2F2023-10-02T12%3A00%3A00Z 114/0 +5ms
  fetch:retry Retry http://marineregions.org/mrgid/7494?t=1704805889 156/0 +1ms
  fetch:retry Retry http://marineregions.org/mrgid/7496?t=1704805889 153/0 +5ms
  ...

I’d also look rename the --retry-count parameter to --max-retries

pietercolpaert commented 3 months ago

I sit also possible there’s no exponential back-off anymore, and it just retires as fast as possible?

pietercolpaert commented 2 months ago

I think this is fixed now - can you check?