Open bodom0015 opened 4 years ago
BUG: Needed refresh after deleting datasets to see newly registered ones (known issue: https://github.com/whole-tale/dashboard/issues/427)
BUG: Searching for this DOI/URL only returned No matching results found - @Xarthisius has said previously that this is a known issue with Globus/MDF dataset registration
BUG: Adding too many datasets pushes select-data-modal's Submit button of the screen - same issue as https://github.com/whole-tale/dashboard/issues/399, but possibly needs to be adjusted for smaller screens? PR: https://github.com/whole-tale/dashboard/pull/623
BUG: Deleting a single file from a folder cleared multiple files from view fixed on master
BUG: Rename allows duplicates, but a refresh reveals that saving has failed - filed as https://github.com/whole-tale/dashboard/issues/622
BUG: "Copy to Workspace" threw a stack trace when attempting to move/copy a specific instance of a file - other files seemed to work fine, unclear what caused the error
BUG: dataverse.harvard.org is down - cannot generate or add API keys. Validation error message is blank in this case fixed on master
BUG: Invalid metadata (datasets) prevents deleting Tale - needed to manually remove datasets from Tale before Girder allows you to delete it
BUG: Notebook cell throws an error - no Texas
STAGE: LIGO Tale missing from dashboard.stage.wholetale.org - could it be marked as private by mistake? use a different public Tale for now
TEST: Filter is no longer reset on navigation
TEST: Space(s) in test URL(s) should be replaced with %20
PR for test plan improvements: https://github.com/whole-tale/wt-design-docs/pull/134
BUG
: an issue with the code that will require a pull request to correctTEST
: an issue with the instructions provided in the test plan / documentationSTAGE
: an issue specific to the staging server's state
- BUG: dataverse.harvard.org is down - cannot generate or add API keys. Validation error message is blank in this case
Where did you see this? It's .edu not .org That's why it's not there.
- BUG: dataverse.harvard.org is down - cannot generate or add API keys. Validation error message is blank in this case
Where did you see this? It's .edu not .org That's why it's not there.
I thought this went in for v0.9rc3, but it has not. Sorry!
Ah, that makes sense :+1: I probably should've noticed that hehe
It was when connecting an external account via API key.. I was using the link in the modal to set link me off to each server and set up API keys, but the last Dataverse one didn't work.
Test Plan
https://github.com/whole-tale/wt-design-docs/issues/new?template=test_plan.md
Note: For all tests, repeat for supported browser/OS combinations.
Preconditions:
Authentication
[x] Basic login flow
[x] Basic logout flow
[x] Return-route for non-logged in users (#300)
Navigation
Browse
Preconditions:
Assumes production Tales present (e.g., LIGO, materials, etc).
No running instances
[x] General
[x] Search
STAGE: LIGO Tale missing from dashboard.stage.wholetale.org - could it be marked as private by mistake?
TEST: Filter is no longer reset
STAGE: LIGO Tale missing from dashboard.stage.wholetale.org - could it be marked as private by mistake?
STAGE: LIGO Tale missing from dashboard.stage.wholetale.org - could it be marked as private by mistake?
Manage
Preconditions
Empty home directory
No registered data
[x] Register General
[x] Register DataONE data
10.5065/D6862DM8
BUG: Needed refresh after deleting datasets to see newly registered ones
[x] Dataverse
[ ] Globus/MDF
BUG: Searching for this DOI/URL only returned
No matching results found.
Run
Preconditions:
No running Tale instances
[x] General
[x] Interact tab
[x] Files tab
[x] Metadata tab - Owned Tale
Environment
dropdown menuLicense
dropdownCreated by <your_name>
underAuthors
Published Location
readsThis Tale has not been published
BUG: Adding too many datasets pushes select-data-modal's Submit button of the screen
BUG: Deleting a single file from a folder cleared multiple files from view - this has already been fixed in master
[x] External data
doi:10.18739/A29G5GD0V
) on Manage > Data (see Manage > Register test cases above)[x] Workspaces
BUG: Rename allows duplicates, but a refresh reveals that saving has failed BUG: "Copy to Workspace" threw a stack trace when attempting to move/copy a specific instance of a file - unclear what caused the error: Failed {"message": "OSError: OSError('Specified file does not exist: /collection/WholeTale Workspaces/WholeTale Workspaces/5e39bf2c8bec16c2663dd8d5/1m.dat',)", "trace": ["<FrameSummary file /girder/girder/api/rest.py, line 630 in endpointDecorator>", "<FrameSummary file /girder/girder/api/rest.py, line 1224 in POST>", "<FrameSummary file /girder/girder/api/rest.py, line 967 in handleRoute>", "<FrameSummary file /girder/girder/api/access.py, line 63 in wrapped>", "<FrameSummary file /girder/girder/api/describe.py, line 709 in wrapped>", "<FrameSummary file /girder/girder/api/v1/resource.py, line 374 in copyResources>", "<FrameSummary file /girder/girder/models/item.py, line 445 in copyItem>", "<FrameSummary file /girder/girder/events.py, line 314 in trigger>", "<FrameSummary file /girder/plugins/wt_home_dir/server/init.py, line 80 in handler>", "<FrameSummary file /girder/plugins/wt_home_dir/server/lib/EventHandlers.py, line 214 in run>", "<FrameSummary file /girder/plugins/wt_home_dir/server/lib/EventHandlers.py, line 199 in assertIsValidFile>"], "type": "internal"}
run-local.sh
tagmanifest-sha256.txt
tagmanifest-md5.txt
manifest-sha256.txt
manifest-md5.txt
bag-info.txt
README.md
bagit.txt
fetch.txt
data/
metadata/
metadata
foldermanifest.json
andenvironment.json
fileLICENSE
fileSettings
[x] Default State
[x] Connect to DataONE
[x] Connect to Dataverse
BUG: http://dataverse.harvard.org/ is down - cannot generate or add API keys. Validation error message is blank in this case
[x] Connect to Zenodo
[x] Confirm tokens retained across logins #370
/user/me
endpoint to confirm tokens are still presentTale Creation
BUG: Invalid metadata prevents deleting Tale { "field": "id", "message": "No such item: 59aeb3f246a83d0001ab6771", "type": "validation" }
[x] Compose Jupyter Tale
[x] Compose OpenRefine Tale
[x] Too many instances
STAGE: Clearing out old datasets from staging may break some existing Tales - need to manually remove datasets before Girder allows you to delete
Analyze in Whole Tale
Task 1: Importing a Dataset from Dataverse
These test cases cover potential situations that can occur when importing datasets from Dataverse.
Testing Steps:
Replication Data for: "Agricultural Fires and Health at Birth"
Input data
section matches the uri withData Source
appendedCreate New Tale and Launch
button is disabledCreate New Tale and Launch
science
Task 2: Importing a Dataset from DataONE
These test cases cover different scenarios that may happen when importing datasets from DataONE.
This test covers the ideal case where dataset importing has all of the needed information to properly run. This includes the dataset location, title, and selected environment.
Testing Steps:
Fire influences on forest recovery and associated climate feedbacks in Siberian Larch Forests, Russia
Selected data
section matches the uri withData Source
appendedRstudio
is selected in the Environments widgetCreate New Tale and Launch
button is enabledCreate New Tale and Launch
science
Analyze in Whole Tale
feature is deployed across a few DataONE test sites. This test ensures Whole Tale has the ability to import data from each of them.Links:
Testing Steps:
Create New Tale and Launch
TEST: Space(s) in test URL(s) should be replaced with %20
Task 3: Shared Behavior
These cases show errors that are common between Dataverse and DataONE. Although they are tested using DataONE URIs, the errors should be the same when replacing it with a Dataverse URI.
This test covers the case where the name query parameter is missing. The expected behavior is that the uri query parameter is used instead.
Testing Steps:
https://dataverse.harvard.edu/api/access/datafile/3323458
Selected data
section matches the uri withData Source
appendedCreate New Tale and Launch
button is disabledCreate New Tale and Launch
This test covers the case where a user imports data from an external source and selects READ/WRITE in the Create Tale Modal.
Testing Steps (Variant 1):
Selected data
section matches the uri withData Source
appendedCreate New Tale and Launch
button is disabledREAD/WRITE
Create New Tale and Launch
Testing Steps (Variant 2):
Selected data
section matches the uri withData Source
appendedCreate New Tale and Launch
button is disabledREAD/WRITE
Create New Tale and Launch
Tale metadata tests
The purpose of these tests are to confirm that the metadata files (manifest.json, environment.json, LICENSE) we generate are correct.
[x] manifest.json
manifest.json
file undermetadata/
schema:author
createdBy
aggregates
aggregates
Datasets
[x] environment.json
metadata/environment.json
config
section from girder matches theconfig
section inenvironment.json
[x] LICENSE
LICENSE
fileLICENSE
file matches the selected license on the metadata pageLICENSE
changed appropriatelyPublishing tests
[x] Case 1: No Accounts Configured
Publish tale...
Go to Settings
[x] Case 2: Publishing to a Third Party
Publish tale...
Publish
metadata.xml
LICENSE
README.md
manifest.json
environment.json
Repeat for each third party provider
a. After publishing to DataONE, use girder to query the Tale
b. Ensure that the 'pid' field in the 'publishInfo' object has an identifier in a doi format
[x] Case 3: Re-published Tale
Published Location
in Run > metadataPublished Location
has changed to the correct package landing pageZenodo integration tests
doi:10.5281/zenodo.16384
ver_1
https://zenodo.org/record/1172960#.XidIvlNKh24
ver_2
doi:10.5281/zenodo.1172960
ver_2
doi:10.5281/zenodo.608984
ver_2
The register tests the following cases.
The register tests the following cases.
publishInfo
field on the tale object contains pid, repository, repository_id, uriBUG: Notebook cell throws an error - No Texas :(
AttributeError Traceback (most recent call last)