KatieWoe
commented
3 years ago QA is done with spot check.
Closed pixelzoom closed 3 years ago
KatieWoe
commented
3 years ago QA is done with spot check.
pixelzoom
commented
3 years ago Thanks @KatieWoe and QA team. I'll proceed with production deploy.
@KatieWoe, @kathy-phet, @amanda-phet, natural-selection/1.4.0-rc.3 is ready for RC testing.
Document issues in https://github.com/phetsims/natural-selection/issues and link to this issue.
This is a spot-check, with no specific platforms that need testing. The major issues to verify are for PhET-iO, but please give brand=phet a quick test.
Assigning to @kathy-phet and @KatieWoe for prioritization.
General RC Test
What to Test
- Click every single button. - Test all possible forms of input. - Test all mouse/trackpad inputs. - Test all touchscreen inputs. - If there is sound, make sure it works. - Make sure you can't lose anything. - Play with the sim normally. - Try to break the sim. - Test all query parameters on all platforms. See [QA Book](https://github.com/phetsims/QA/blob/master/documentation/qa-book.md) for a list of query parameters. - Download HTML on Chrome and iOS. - Make sure the iFrame version of the simulation is working as intended on all platforms. - Make sure the XHTML version of the simulation is working as intended on all platforms. - Complete the test matrix. - Don't forget to make sure the sim works with Legends of Learning. - Test the Game Up harness on at least one platform. - Check [this](https://docs.google.com/spreadsheets/d/1umIAmhn89WN1nzcHKhYJcv-n3Oj6ps1wITc-CjWYytE/edit#gid=0) LoL spreadsheet and notify AR or AM if it not there. - If this is rc.1 please do a memory test. - When making an issue, check to see if it was in a previously published version - Try to include version numbers for browsers - If there is a console available, check for errors and include them in the Problem Description. - As an RC begins and ends, check the sim repo. If there is a maintenance issue, check it and notify developers if there is a problem. -Issues to Verify
- [x] https://github.com/phetsims/natural-selection/issues/291 These issues have the "status:ready-for-qa" label. Check these issues off and close them if they are fixed. Otherwise, post a comment in the issue saying that it wasn't fixed and link back to this issue.Link(s)
- **[Simulation](https://phet-dev.colorado.edu/html/natural-selection/1.4.0-rc.3/phet/natural-selection_all_phet.html)** - **[iFrame](https://phet-dev.colorado.edu/html/natural-selection/1.4.0-rc.3/phet/natural-selection_all_iframe_phet.html)** - **[XHTML](https://phet-dev.colorado.edu/html/natural-selection/1.4.0-rc.3/phet/xhtml/natural-selection_all.xhtml)** - **[**Test Matrix**](link)**PhET-iO RC Test
What to Test
- Make sure that public files do not have password protection. Use a private browser for this. - Make sure that private files do have password protection. Use a private browser for this. - Make sure standalone sim is working properly. - Make sure the wrapper index is working properly. - Make sure each wrapper is working properly. - Launch the simulation in Studio with ?stringTest=xss and make sure the sim doesn't navigate to youtube - For newer PhET-iO wrapper indices, save the "basic example of a functional wrapper" as a .html file and open it. Make sure the simulation loads without crashing or throwing errors. - For an update or maintenance release please check the backwards compatibility of the playback wrapper. [Here's the link to the previous wrapper.](https://phet-io.colorado.edu/sims/natural-selection/1.3/) - Load the login wrapper just to make sure it works. Do so by adding this link from the sim deployed root: ``` /wrappers/login/?wrapper=record&validationRule=validateDigits&&numberOfDigits=5&promptText=ENTER_A_5_DIGIT_NUMBER ``` Further instructions in QA Book - Conduct a recording test to Metacog, further instructions in the QA Book. Do this for iPadOS + Safari and one other random platform. - Conduct a memory test on the stand alone sim wrapper (rc.1). - Test one platform combination with `?phetioDebug` on the Studio and State wrapper. - If Pan/Zoom is supported, make sure that it works when set with PhET-iO State. - If filled in by issue creator, please test the diff wrapper against [version 1.3.1](https://phet-io.colorado.edu/sims/natural-selection/1.3/) - Test that the sim works offline: * Go to https://phet-dev.colorado.edu/html/natural-selection/1.4.0-rc.3/phet-io/natural-selection-phet-io-1.4.0-rc.3.zip * download it * unzip it to a spot locally * Open `index.html` by double clicking it on your desktop or in a finder-view. * It should look like the standalone version of the sim in PhET-iO brand.Issues to Verify
- [x] https://github.com/phetsims/natural-selection/issues/298 - [x] https://github.com/phetsims/natural-selection/issues/300 - [x] https://github.com/phetsims/natural-selection/issues/303 These issues have the "status:ready-for-qa" label. Check these issues off and close them if they are fixed. Otherwise, post a comment in the issue saying that it wasn't fixed and link back to this issue.Link(s)
- **[Wrapper Index](https://phet-dev.colorado.edu/html/natural-selection/1.4.0-rc.3/phet-io/)** - **[**Test Matrix**](link)**FAQs for QA Members
There are multiple tests in this issue... Which test should I do first?
Test in order! Test the first thing first, the second thing second, and so on.How should I format my issue?
Here's a template for making issues: Test Device blah Operating System blah Browser blah Problem Description blah Steps to Reproduce blah Visuals blahTroubleshooting Information
blahWho should I assign?
We typically assign the developer who opened the issue in the QA repository.My question isn't in here... What should I do?
You should: 1. Consult the [QA Book](https://github.com/phetsims/QA/blob/master/documentation/qa-book.md). 2. Google it. 3. Ask Katie. 4. Ask a developer. 5. Google it again. 6. Cry.