Read timeout error on large bundle ingestion - Githubissues

NASA-PDS / registry-mgr

Standalone Registry Manager application responsible for managing the PDS Registry (https://github.com/NASA-PDS/registry) schemas and indexes.

https://nasa-pds.github.io/registry

Other

0 stars 2 forks source link

Read timeout error on large bundle ingestion #29

Closed jordanpadams closed 2 years ago

jordanpadams commented 3 years ago

🐛 Describe the bug

Per email conversation with GEO, while stress testing with PDS4 MER Pancam data ingestion, encountered a Read Timeout error.

📜 To Reproduce

Steps to reproduce the behavior:

Harvest the MER Pancam bundle
Execute registry-mgr like the following:

registry-mgr load-data -dir E:\path\to\data

Read timeout occurs

🕵️ Expected behavior

registry-mgr ingests the data successfully

📚 Version of Software Used

pds-registry-app 0.3.2 registry-mgr 4.1.0

🩺 Test Data / Additional context

data generated by harvest: https://ode.rsl.wustl.edu/cartdownload/?requestdir=regTest

4 MER bundles (URLs TBD):

mer\mer1-m-pancam-3-iofcal-sci-v2\mer1pc_3002
mer\mer1-m-pancam-2-edr-sci-v1\mer1pc_0xxx
mer\mer1-m-pancam-3-radcal-sci-v2\mer1pc_1002
mer\mer1-m-pancam-5-color-mosaics-sci-v1\mer1pc_2xxx

🏞Screenshots

🖥 System Info

OS: Windows
File system: using high speed (solid state I believe) network storage that is used for our VMs. This is a VM.

:unicorn: Applicable requirements

tdddblog commented 2 years ago

Invalid. Could not reproduce.

jordanpadams commented 2 years ago

@tdddblog did we figure out what the issue was with GEO's ingestion?

tdddblog commented 2 years ago

I think there was something wrong with the mount / network.

jordanpadams commented 2 years ago

closing as invalid for now. will revisit it is pops up again