archivematica / testing-checklists

Trying to manage release testing better.
4 stars 1 forks source link

Test 3 #3

Closed sallain closed 5 years ago

sallain commented 5 years ago

1 - Transfer Types

1.1

Severity: High

Current test coverage: null

External tools: null

1.2

Severity: High

Current test coverage: null

External tools: null

1.3

Severity: High

Current test coverage: null

External tools: 7zip

1.4

Severity: High

Current test coverage: null

External tools: null

1.5

Severity: Medium

Current test coverage: null

External tools: tsk_recover (Sleuthkit); unrar-free

1.6

Severity: Low

Current test coverage: null

External tools: null

2 - Transfer Variants

2.1

Severity: High

Current test coverage: null

External tools: null

2.2

Severity: High

Current test coverage: null

External tools: null

2.3

Severity: Medium

Current test coverage: null

External tools: null

2.4

Severity: High

Current test coverage: null

External tools: null

2.5

Severity: High

Current test coverage: null

External tools: null

2.6

Severity: High

Current test coverage: null

External tools: null

2.7

Severity: Medium

Current test coverage: null

External tools: null

2.8

Severity: Medium

Current test coverage: null

External tools: null

When the transfer is processed as a Standard transfer

2.9

Severity: Low

Current test coverage: null

External tools: null

3 - Checksums & Integrity Checking

3.1

Severity: High

Current test coverage: null

External tools: null

3.2

Severity: High

Current test coverage: null

External tools: null

4 - Virus scanning & quarantine

4.1

Severity: High

Current test coverage: null

External tools: null

4.2

Severity: High

Current test coverage: null

External tools: null

4.3

Severity: Low

Current test coverage: null

External tools: null

4.5

Severity: Low

Current test coverage: null

External tools: null

4.6

Severity: Low

Current test coverage: null

External tools: null

5 - Package Extraction

5.1

Severity: Medium

Current test coverage: null

External tools: null

5.2

Severity: Medium

Current test coverage: null

External tools: null

5.3

Severity: Medium

Current test coverage: null

External tools: null

5.4

Severity: Medium

Current test coverage: null

External tools: null

6 - File Identification

6.1

Severity: High

Current test coverage: null

External tools: Siegfried

When a transfer is processed

6.2

Severity: High

Current test coverage: null

External tools: Siegfried

When a transfer that includes the known format is processed with "Perform file format identification (Transfer)" set to Yes

6.3

Severity: High

Current test coverage: null

External tools: Siegfried

When a transfer includes a format that is unknown to Siegfried is processed with "Perform file format identification (Transfer)" set to Yes

6.4

Severity: High

Current test coverage: null

External tools: Fido

When a transfer is processed with "Perform file format identification (Transfer)" set to Yes

6.5

Severity: High

Current test coverage: null

External tools: Fido

When a transfer that includes the known format is processed with "Perform file format identification (Transfer)" set to Yes

6.6

Severity: High

Current test coverage: null

External tools: Fido

When a transfer includes a format that is unknown to Fido is processed with "Perform file format identification (Transfer)" set to Yes

6.7

Severity: High

Current test coverage: null

External tools: File extension script

When a transfer is processed with "Perform file format identification (Transfer)" set to Yes

6.8

Severity: Medium

Current test coverage: null

External tools: null

7 - Validation

7.1

Severity: High

Current test coverage: null

External tools: JHOVE

7.2

Severity: Medium

Current test coverage: null

External tools: MediaConch

7.3

Severity: Low

Current test coverage: null

External tools: MediaConch

When a transfer containing material that meets the policy criteria is processed with "Perform policy checks on originals" set to Yes

8 - Characterization

8.1

Severity: High

Current test coverage: null

External tools: FFprobe, ExifTool, MediaInfo, FITS, fiwalk (Sleuthkit)

9 - Normalization

9.1

Severity: null

Current test coverage: null

External tools: null

When the user selects "normalize for preservation and access" at the Normalize job

9.2

Severity: null

Current test coverage: null

External tools: null

When the user selects "normalize for preservation" at the Normalize job

9.3

Severity: null

Current test coverage: null

External tools: null

When the user selects "normalize service files for access" at the Normalize job

9.4

Severity: null

Current test coverage: null

External tools: null

When the user selects "do not normalize" at the Normalize job

9.5

Severity: null

Current test coverage: null

External tools: null

When the user manually inserts normalized files into the SIP (by accessing the pipeline's processing location directly via SSH or SFTP) using the required directory structure (see documentation)

And then selects "Approve" at the Approve normalization job

9.6

Severity: null

Current test coverage: null

External tools: null

When the user clicks on the metadata icon and then "Manual normalization event detail"

9.7

Severity: null

Current test coverage: null

External tools: null

When the user selects "normalize for access" at the Normalize job

9.8

Severity: null

Current test coverage: null

External tools: null

When the user reaches the Normalize job

9.9

Severity: null

Current test coverage: null

External tools: null

When the user reaches the Normalize job and chooses "Do not normalize"

9.11

Severity: Medium

Current test coverage: null

External tools: convert (ImageMagick)

9.12

Severity: null

Current test coverage: null

External tools: null

9.13

Severity: null

Current test coverage: null

External tools: null

9.14

Severity: Medium

Current test coverage: null

External tools: Tesseract

When a transfer is processed with "Transcribe files (OCR)" set to Yes

10 - Sanitize Names & Special Characters

10.1

Severity: High

Current test coverage: null

External tools: null

10.2

Severity: Low

Current test coverage: null

External tools: Bulk Extractor

When a transfer is processed with "Examine contents" set to Yes

11 - Performance & Resilience

11.1

Severity: Medium

Current test coverage: null

External tools: null

11.2

Severity: Medium

Current test coverage: null

External tools: null

11.3

Severity: Medium

Current test coverage: null

External tools: null

11.4

Severity: Medium

Current test coverage: null

External tools: null

11.5

Severity: Medium

Current test coverage: null

External tools: null

12 - Add Metadata

12.1

Severity: Medium

Current test coverage: null

External tools: null

When they click on the metadata icon for a transfer/SIP proir to the metadata reminder microservice

12.2

Severity: High

Current test coverage: null

External tools: null

When they click on the metadata icon for a transfer/SIP proir to the metadata reminder microservice

12.3

Severity: High

Current test coverage: null

External tools: null

When the transfer is processed

13 - Backlog

13.1

Severity: High

Current test coverage: null

External tools: null

When the user downloads the transfer from the backlog

13.2

Severity: High

Current test coverage: null

External tools: null

When the user searches the backlog using the search interface on the Backlog tab

13.3

Severity: Medium

Current test coverage: null

External tools: null

When the user creates a delete request and the delete request is approved in the Storage Service

14 - Appraisal

14.1

Severity: High

Current test coverage: null

External tools: null

When the user searches using the search interface on the Appraisal tab

14.2

Severity: Medium

Current test coverage: null

External tools: null

When the user selects Collapse all/Expand all

14.3

Severity: Medium

Current test coverage: null

External tools: null

When the user selects Deselect all

14.4

Severity: Medium

Current test coverage: null

External tools: null

When they add a tag to the selected files

14.5

Severity: Low

Current test coverage: null

External tools: null

When they click on the minus sign to remove the tag in the Backlog pane or File list pane

14.6

Severity: null

Current test coverage: null

External tools: null

When they create a SIP from the tags in the Arrangement tab

14.7

Severity: Low

Current test coverage: null

External tools: null

When the user opens the Report on the Analysis pane > Objects

14.8

Severity: Low

Current test coverage: null

External tools: null

When the user opens the Visualizations on the Analysis pane > Objects

14.9

Severity: Low

Current test coverage: null

External tools: null

And the transfer was processed with "Examine contents" set to Yes

When the user selects PII or Credit card numbers on the Analysis pane > Examine contents

14.1

Severity: Low

Current test coverage: null

External tools: null

When the user selects Preview File on the Analysis pane

14.11

Severity: Low

Current test coverage: null

External tools: null

14.12

Severity: Low

Current test coverage: null

External tools: null

When the user clicks on "Add directory" in the Arrangement pane

14.13

Severity: Low

Current test coverage: null

External tools: null

When the user selects the directory and then clicks on "Add directory"

14.14

Severity: Low

Current test coverage: null

External tools: null

When the user wants to navigate through the directories

14.15

Severity: Low

Current test coverage: null

External tools: null

When the user selects a file and then clicks on "Edit Metadata"

14.16

Severity: Low

Current test coverage: null

External tools: null

When the user selects a directory/file and then clicks on "Delete selected"

14.17

Severity: Low

Current test coverage: null

External tools: null

When the user selects a directory and clicks on "Create SIP"

14.18

Severity: Low

Current test coverage: null

External tools: null

When the user clicks "Reload"

15 - Archivesspace - Appraisal tab workflow

15.1

Severity: Low

Current test coverage: null

External tools: null

When a user clicks on "Search ArchivesSpace" in the ArchivesSpace pane

15.2

Severity: Low

Current test coverage: null

External tools: null

When the user selects "Add new child record"

15.3

Severity: Low

Current test coverage: null

External tools: null

When the user selects "Add new digital object"

15.3

Severity: Low

Current test coverage: null

External tools: null

When the user drags and drops a file from the backlog pane onto the digital object record

15.4

Severity: Low

Current test coverage: null

External tools: null

When the user selects "Edit rights metadata"

15.5

Severity: Low

Current test coverage: null

External tools: null

When the user selects "Edit metadata"

15.6

Severity: Low

Current test coverage: null

External tools: null

When the user selects "Delete selected"

15.7

Severity: Low

Current test coverage: null

External tools: null

When the user selects the parent record and clicks on "Finalize arrangement"

16 - Integrations: Access Systems

16.1

Severity: High

Current test coverage: null

External tools: null

When a user uploads a DIP to AtoM

16.2

Severity: High

Current test coverage: null

External tools: null

When the user uploads the DIP to AtoM

16.3

Severity: null

Current test coverage: null

External tools: null

When the DIP is uploaded to AtoM

16.4

Severity: High

Current test coverage: null

External tools: null

When the DIP is uploaded to AtoM

16.5

Severity: High

Current test coverage: null

External tools: null

When the DIP is uploaded to AtoM

16.6

Severity: Low

Current test coverage: null

External tools: null

When a user creates a DIP and uploads it to Binder

16.7

Severity: Low

Current test coverage: null

External tools: null

When the DIP is uploaded to Binder

16.8

Severity: Low

Current test coverage: null

External tools: null

When the user selects "Upload DIP to ArchivesSpace" from the Upload DIP microservice drop-down

16.9

Severity: Low

Current test coverage: null

External tools: null

When the user confirms that matching is complete

16.1

Severity: Low

Current test coverage: null

External tools: null

When the user selects "Upload DIP to ArchivesSpace" from the Upload DIP microservice drop-down

16.11

Severity: Low

Current test coverage: null

External tools: null

When "Upload DIP to CONTENTdm" is selected during the Upload DIP microservice

17 - Archival Storage

17.1

Severity: High

Current test coverage: null

External tools: null

When a user selects the storage location from the Store AIP dropdown

17.2

Severity: Medium

Current test coverage: null

External tools: null

When the user selects to reject the transfer/SIP

17.3

Severity: High

Current test coverage: null

External tools: null

When the user searches using the search interface on the Archival Storage tab

17.4

Severity: null

Current test coverage: null

External tools: null

When the user does a search with "Show files?" selected

17.5

Severity: High

Current test coverage: null

External tools: null

When the user clicks on the name or UUID of the AIP

17.6

Severity: null

Current test coverage: null

External tools: null

When the user clicks on "Create an AIC"

17.7

Severity: null

Current test coverage: null

External tools: null

When the user clicks on "Download"

17.8

Severity: null

Current test coverage: null

External tools: null

When the user clicks on "View" to view the pointer file

17.9

Severity: null

Current test coverage: null

External tools: null

When the user wants to upload just the descriptive metadata to an AtoM description by entering the AtoM slug in the Upload DIP pane

17.1

Severity: High

Current test coverage: null

External tools: null

When the user selects "Metadata re-ingest" from the AIP information page

17.11

Severity: null

Current test coverage: null

External tools: null

When the user selects "Partial re-ingest" from the AIP information page

17.12

Severity: null

Current test coverage: null

External tools: null

When the user selects "Full re-ingest" from the AIP information page

17.13

Severity: High

Current test coverage: null

External tools: null

When the user requests deletion of the AIP from the AIP information page

18 - Preservation Planning

18.1

Severity: null

Current test coverage: null

External tools: null

When the user enables Fido

18.2

Severity: null

Current test coverage: null

External tools: null

When a transfer that would normally call that command is processed • Then the command will not run AND

18.3

Severity: null

Current test coverage: null

External tools: null

When a transfer that calls the command is processed

18.4

Severity: High

Current test coverage: null

External tools: null

When the user wants to revert to the previous command

19 - Access

19.1

Severity: Medium

Current test coverage: null

External tools: null

When the user looks at the Access tab

20 - Administration

20.1

Severity: null

Current test coverage: null

External tools: null

When the user selects "Edit"

20.2

Severity: High

Current test coverage: null

External tools: null

When a transfer is started from the dashboard

20.3

Severity: null

Current test coverage: null

External tools: null

When the user selects "Download"

20.4

Severity: null

Current test coverage: null

External tools: null

When the user selects "Reset"

20.5

Severity: null

Current test coverage: null

External tools: null

When the user selects "Add"

20.6

Severity: null

Current test coverage: null

External tools: null

When the user selects "Delete" for the custom processing configuration

20.7

Severity: Medium

Current test coverage: null

External tools: null

When the user selects "Clear" for one of the storage locations

20.8

Severity: null

Current test coverage: null

External tools: null

When the user uploads a DIP to those systems

20.9

Severity: High

Current test coverage: null

External tools: null

When the user creates an AIP

20.1

Severity: High

Current test coverage: null

External tools: null

When the user views the dashboard

20.11

Severity: Medium

Current test coverage: null

External tools: null

21 - Users & Permissions

21.1

Severity: High

Current test coverage: null

External tools: null

When the user goes to Administration > Users

21.2

Severity: null

Current test coverage: null

External tools: null

When the user goes to the Administration tab

22 - Failure Reports & Notifications

22.1

Severity: High

Current test coverage: null

External tools: null

When the user views Administration > Failures

22.2

Severity: High

Current test coverage: null

External tools: null

When a transfer fails

23 - System Config Options

23.1

Severity: Medium

Current test coverage: null

External tools: null

When the user opens the dashboard

23.2

Severity: Low

Current test coverage: null

External tools: null

When the user views the task ouptut page for a job that normally has some output in the standard out and standard error streams (i.e. characterize and extract metadata)

24 - Storage Service

24.1

Severity: High

Current test coverage: null

External tools: null

When the user views the Packages tab of the Storage Service

24.2

Severity: High

Current test coverage: null

External tools: null

When the user deletes the DIP from the Packages tab

24.4

Severity: null

Current test coverage: null

External tools: null

When a Storage Service admin rejects the Deletion requests in the Storage Service

24.4

Severity: null

Current test coverage: null

External tools: null

When a Storage Service admin approves the Deletion requests in the Storage Service

25 - METS Validation

25.1

Severity: High

Current test coverage: null

External tools: METS-RW

When the user validates the METS file against the PREMIS in METS Toolbox validator (http://pim.fcla.edu/validate)

25.2

Severity: High

Current test coverage: null

External tools: METS-RW

When the user validates the METS file against the Archivematica METS profile (created by Evelyn, not hosted anywhere yet...)