search

netwerk-digitaal-erfgoed / ld-workbench

A CLI tool for transforming large RDF datasets using pure SPARQL.
5 stars 1 forks source link

crash on Timeout Error #13

Closed EnnoMeijers closed 5 months ago

EnnoMeijers commented 11 months ago

When the SPARQL endpoint timeout occurs the pipeline crashes with:

TypeError: fetch failed
.....
{
  cause: ConnectTimeoutError: Connect Timeout Error
      at onConnectTimeout (node:internal/deps/undici/undici:6869:28)
      at node:internal/deps/undici/undici:6825:50
      at Immediate._onImmediate (node:internal/deps/undici/undici:6857:13)
      at process.processImmediate (node:internal/timers:478:21) {
    code: 'UND_ERR_CONNECT_TIMEOUT'
}
mightymax commented 11 months ago

Did it timeout on the iterator or the generator? The whole purpose if this tool is to not have timeouts anymore ;-)

If possible, please share your pipeline configuration in this issue. If not, please send them to me via e-mail.

EnnoMeijers commented 11 months ago

I am not quite sure on which part it timed out. See my setup in the tests branch: https://github.com/netwerk-digitaal-erfgoed/ld-workbench/tree/tests/static/kb-nbt

EnnoMeijers commented 11 months ago

I ran another test and I can confirm that the error occurs in the iterator step.

mightymax commented 5 months ago

@EnnoMeijers can you (re)confirm this is still an issue?

EnnoMeijers commented 5 months ago

I'll close the issue for now as it was created before major changes to the code. I created a new one when needed.