artefactual / archivematica-sampledata

Archivematica sample data
http://www.archivematica.org
17 stars 15 forks source link

WIP: Reorganize AMAUAT sample data #67

Open ross-spencer opened 4 years ago

ross-spencer commented 4 years ago

Automated acceptance tests use specific transfers within the sample data repository that enable the results of changes in Archivematica to be measured. We also use the sample data to test standard workflows during day to day testing and demonstration. A change to one of these transfers, e.g. the addition of a file, or a change to one, can impact the ability for automated acceptance tests to pass where results are expected to be controlled.

This PR separates the AMAUAT data from the standard sample data by duplicating it where appropriate or moving it. This PR should allow us to more expressively organize the sample data in this repository moving forward, including starting to delete unneeded sample data or improve that which is there.

We create a new top-level AMAUAT folder and store all AMAUAT transfers there. Organized initially by transfer type.

tree -d amauat-automated-acceptance-tests/
amauat-automated-acceptance-tests/
├── bagit
│   ├── BagTransfer
│   │   └── data
│   │       └── bagTest
│   └── UnzippedBag
│       └── data
├── Dataverse
│   └── NDSAStaffingReport
│       └── metadata
└── standard-transfer
    ├── badNames
    │   ├── logs
    │   │   └── fileMeta
    │   ├── metadata
    │   │   └── submissionDocumentation
    │   └── objects
    │       ├── ^
    │       ├── <
    │       ├── >
    │       ├── _
    │       ├── ,
    │       ├── :
    │       ├── !
    │       ├── ?
    │       ├── @
    │       ├── $
    │       ├── *
    │       ├── &
    │       ├── #
    │       ├── %
    │       ├── +
    │       ├── backward\slash
    │       ├── (brackets)
    │       ├── {curlyBrackets}
    │       ├── ends with a space 
    │       ├── period.
    │       ├── 'quote'
    │       ├── "quote"
    │       └──  starts with a space
    ├── broken_package_format_types
    │   ├── gz
    │   ├── rar_1
    │   ├── rar_2
    │   ├── tar
    │   └── zip
    ├── DemoTransferCSV
    │   ├── metadata
    │   │   └── submissionDocumentation
    │   └── objects
    │       └── artwork
    ├── fixityCheckShouldFail
    │   ├── logs
    │   ├── metadata
    │   │   └── submissionDocumentation
    │   └── objects
    ├── manual-normalization
    │   └── manualNormalization
    │       └── preservation
    ├── OfficeDocs
    │   ├── logs
    │   │   └── fileMeta
    │   ├── metadata
    │   │   └── submissionDocumentation
    │   └── objects
    ├── pictures
    ├── pid-binding
    │   ├── hierarchy-with-empty-dir
    │   │   ├── dir1
    │   │   │   └── dir1a
    │   │   │       └── dir1ai
    │   │   └── dir2
    │   │       └── dir2a
    │   │           ├── dir2ai
    │   │           ├── dir2aii
    │   │           └── dir2aiii
    │   └── hierarchy-with-empty-dir-compressed
    ├── preforma
    │   ├── all-conform-policy
    │   ├── all-conform-policy-norm-acc
    │   ├── all-conform-policy-originals
    │   ├── all-valid
    │   ├── manually-normalized-access-all-conform-policy
    │   │   └── manualNormalization
    │   │       └── access
    │   ├── manually-normalized-access-none-conform-policy
    │   │   └── manualNormalization
    │   │       └── access
    │   ├── manually-normalized-preservation-all-conform-policy
    │   │   └── manualNormalization
    │   │       └── preservation
    │   ├── manually-normalized-preservation-none-conform-policy
    │   │   └── manualNormalization
    │   │       └── preservation
    │   ├── none-conform-policy
    │   ├── none-conform-policy-norm-acc
    │   ├── none-conform-policy-originals
    │   ├── none-valid
    │   ├── when-normalized-access-all-valid
    │   ├── when-normalized-all-valid
    │   └── when-normalized-none-valid
    ├── Unicode
    │   ├── logs
    │   ├── metadata
    │   │   └── submissionDocumentation
    │   └── objects
    └── virusTests
        └── metadata

Connected to archivematica/issues#851 Connected to https://github.com/archivematica/Issues/issues/859

This re-organization requires https://github.com/artefactual-labs/archivematica-acceptance-tests/pull/153 to ensure AMAUAT remain functional.

This test makes it easier to control the changes introduced with https://github.com/artefactual/archivematica-sampledata/pull/66 where bag transfers are isolated to enable more bag types to be added, e.g. with a processing configuration or DC metadata.