Move large test data files into SAN storage area

pace-neutrons / Horace

Horace is a suite of programs for the visualization and analysis of large datasets from time-of-flight neutron inelastic scattering spectrometers.

https://pace-neutrons.github.io/Horace/stable/

GNU General Public License v3.0

7 stars 4 forks source link

Move large test data files into SAN storage area #199

Open nickbattam-tessella opened 4 years ago

nickbattam-tessella commented 4 years ago

Move all the large datafiles used by Horace/Herbert from GitHub and other network locations into the SAN storage area.

Related to Issue #141

Outcome:

[x] access to SAN from ANVIL build agents
[ ] source and processed data files on SAN storage area
[ ] framework and initial test updated to use SAN area (#388)
[ ] all unit tests updated to pull required data from SAN storage
[ ] existing processed test data removed from GitHub
[ ] updates to SMG documenting how to pass SAN location and credentials to scripts

nickbattam-tessella commented 4 years ago

Unable to access the SAN storage with the local Jenkins user on the ANVIL build agents.

Waiting for anonymous access to be enabled on the share.

ghost commented 4 years ago

SAN now accessible from Jenkins #235

nickbattam-tessella commented 4 years ago

For Jenkins builds the SAN locations and credentials are pulled from from the Jenkins secrets store; for developer/command line execution the users credentials will be used and SAN location must be sourced from somewhere (e.g. env variable set in a script. local.dev file, ...)