search

fcrepo-exts / fcrepo-import-export

Apache License 2.0
15 stars 19 forks source link

Automatic detection of repository root times out with large containers #114

Closed peichman-umd closed 6 years ago

peichman-umd commented 6 years ago

During the export process, the exporter attempts to automatically determine the repository root by traversing the path hierarchy of the given endpoint URL and checking each resource for the presence of a <> rdf:type fedora:RepositoryRoot triple. In cases where there is a container with many children, the request for the container can time out before the response can be generated (in our case at UMD, we have a 10 minute request timeout on our Apache frontend).

Solutions would include:

  1. Allowing the user to explicitly specify the repository root, and thus skip the automatic detection process.
  2. If automatic detection is still required, request the container representations as N-Triples, so the response begins streaming immediately.
peichman-umd commented 6 years ago

Cross-filed as https://jira.duraspace.org/browse/FCREPO-2741

awoods commented 6 years ago

Resolved with: https://github.com/fcrepo4-labs/fcrepo-import-export/commit/98d3702e385a2685214b33a1d932d5eaf954a792