keymanapp / keyman

Keyman cross platform input methods system running on Android, iOS, Linux, macOS, Windows and mobile and desktop web
https://keyman.com/
Other
372 stars 102 forks source link

test(web): feature-branch regression testing - ES modules (🧩), main suite #9037

Closed jahorton closed 10 months ago

jahorton commented 11 months ago

Keyman for Web Acceptance Test Procedures

For this test run, please refer to the builds posted on https://github.com/keymanapp/keyman/pull/8560#issuecomment-1492750092.

As the feature branch has relocated test page resources, note that the links contained herein are updated to point to their new locations. A few extra tests have also been added.

Once the feature-branch lands, updating the regression test spec to use the links from this one will resolve #9023 moving forward. Some of the links may not work on master, though, hence my hesitancy to update them at the moment.

I have dropped SUITE_INSPECT for this run, as it's not against an official release of Keyman, but the rest of these tests should otherwise match what is seen at https://github.com/keymanapp/keyman/wiki/Platform-Acceptance-Test-for-Web at this time.

User Testing

SUITE_DESKTOP: Desktop Platforms

Ensure that all tests in the selections below are run on a representative set of the following browsers and setups:

Baseline Tests

From the testing index page, use the first link ("View Keymanweb use samples") and then select "Example 1" for the following tests.

Text Selection Tests

These tests are all run with the web_context_tests keyboard on the Test unminified Keymanweb test page. They should be run on both INPUT and TEXTAREA elements. Press Ctrl+F5 to reload the page between tests.

Element Attachment Tests

Site-based tests of attachment API

All behavior exhibited here should feel "normal". These tests are solely to ensure that nothing got accidentally broken.

For each of these, make use of the Attachment/Enablement API functionality test page.

Tests CJK keyboard functionality

Use the standard Test unminified Keymanweb test page.

SUITE_TOUCH: Touch platform tests

Ensure that all tests in the selections below are run on a representative set of the following browsers and setups:

Baseline Tests

From the testing index page, use the first link ("View Keymanweb use samples") and then select "Example 1" for the following tests.

Element Attachment Tests

Site-based tests of attachment API

All behavior exhibited here should feel "normal". These tests are solely to ensure that nothing got accidentally broken.

For each of these, make use of the Attachment/Enablement API functionality test page.

keymanapp-test-bot[bot] commented 11 months ago

User Test Results

Test specification and instructions

✅ SUITE_DESKTOP: Desktop Platforms

120 tests in 6 groups PASSED * ✅ GROUP_WINDOWS_FIREFOX:
20 tests PASSED - ✅ **TEST_BASELINE_ADD_SIL_IPA ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598540564))**: Verified that the key sequence n> produced ŋ. ([notes](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598540564)) - ✅ **TEST_BASELINE_ADD_KM ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598540564))**: Verified that the Khmer_Basic keyboard was added. ([notes](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598540564)) - ✅ **TEST_BASELINE_ADD_KHMER_ANGKOR ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598540564))**: Verified that the Khmer_angkor keyboard was added. Able to see ស្រុក by typing key sequence s u j r k. Able to see that the reorder rule test, by hitting Backspace key. - ✅ **TEST_BASELINE_ADD_SPANISH ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598540564))**: Verified that the Spanish keyboard was added to the list. ([notes](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598540564)) - ✅ **TEST_BASELINE_SWEDISH ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598540564))**: Verified that the given key sequences shows the expected output. ([notes](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598540564)) - ✅ **TEST_SELECTION ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600540967))**: Tested in unminified Keymanweb test page and tested in both INPUT and TEXTAREA elements and here is my observations: 1. Verified that the output shows aqx. - ✅ **TEST_SELECTION_2 ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600540967))**: Verified that the output after the final key shows aqx. - ✅ **TEST_CONTEXT_BASE ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600540967))**: Verified that the output finally shows !. - ✅ **TEST_CONTEXT_SELECTION ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600540967))**: Verified that the output shows abcd. - ✅ **TEST_CONTEXT_SELECTION_2 ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600540967))**: Verified that the final key shows !. - ✅ **TEST_CONTEXT_SELECTION_3 ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600540967))**: Verified that the final key shows !. - ✅ **TEST_CONTEXT_SELECTION_4 ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600540967))**: Verified that the final key shows xdx. - ✅ **TEST_SELECTION_SHIFT ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600540967))**: Verified that the pressing shift shows abcx with bc still selected. ([notes](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600540967)) - ✅ **TEST_TYPING_AUTOSCROLL ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602185878))**: Retested as per Josh's suggestion and here my observation: 1. Verified that the text is automatically scrolled so that the last three characters and the caret are fully visible. 2. Verified that the Keyboard is still visible at any point while typing in the input field. - ✅ **TEST_ATTACHMENT_API ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600642018))**: 1. Verified that the 'auto' attachment mode properly and automatically attached to each dynamically-added control. 2. Verified the 'manual' attachment mode results in a page with no KMW-activated controls. 3. Verified that each 'attached' control functions as expected for the selected keyboard(s). 4. Verified that the KeymanWeb properly attaches to and detaches from each relevant type of control. Also, verified that the independent-keyboard management API functions correctly. - ✅ **TEST_NORMAL_USE ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600642018))**: Tested in the given test page and here is my observation : 1. Verified that the keyboard displays and works correctly when the first loaded up. - ✅ **TEST_ELEMENT_HOPPING ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600642018))**: Verified that the OSK remains visible if I jump to another page element and it is automatically hidden if I clicked on the blank area. - ✅ **TEST_SPECIFIC_KEYBOARDS ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600642018))**: Verified that the keyboard changes from one dynamic area to other and it is showing the expected keyboard layout. Seems to be working fine. - ✅ **TEST_JAPANESE_TYPING ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600642018))**: 1. Able to add japanese keyboard. 2. Able to select the second option to replace the existing context. ([notes](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600642018)) - ✅ **TEST_JAPANESE_FOCUS ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600642018))**: 1. Verified that it is possible to see the japanese keyboard when I clicked either in text area or the input field. 2. If I clicked in the black area on the page, the keyboard disappeared. Seems to be working fine. ([notes](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600642018))
* ✅ GROUP_WINDOWS_CHROME:
20 tests PASSED - ✅ **TEST_BASELINE_ADD_SIL_IPA ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598608540))**: Verified that the key sequence n> produced ŋ. ([notes](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598608540)) - ✅ **TEST_BASELINE_ADD_KM ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598608540))**: Verified that the Khmer_Basic keyboard was added. ([notes](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598608540)) - ✅ **TEST_BASELINE_ADD_KHMER_ANGKOR ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598608540))**: Verified that the Khmer_angkor keyboard was added. Able to see ស្រុក by typing key sequence s u j r k. Able to see that the reorder rule test, by hitting Backspace key. - ✅ **TEST_BASELINE_ADD_SPANISH ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598608540))**: Verified that the Spanish keyboard was added to the list. ([notes](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598608540)) - ✅ **TEST_BASELINE_SWEDISH ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598608540))**: Verified that the given key sequences shows the expected output. ([notes](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598608540)) - ✅ **TEST_SELECTION ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600711550))**: Tested in unminified Keymanweb test page and tested in both INPUT and TEXTAREA elements and here is my observations: 1. Verified that the output shows aqx. - ✅ **TEST_SELECTION_2 ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600711550))**: Verified that the output after the final key shows aqx. - ✅ **TEST_CONTEXT_BASE ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600711550))**: Verified that the output finally shows !. - ✅ **TEST_CONTEXT_SELECTION ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600711550))**: Verified that the output shows abcd. - ✅ **TEST_CONTEXT_SELECTION_2 ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600711550))**: Verified that the final key shows !. - ✅ **TEST_CONTEXT_SELECTION_3 ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600711550))**: Verified that the final key shows !. - ✅ **TEST_CONTEXT_SELECTION_4 ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600711550))**: Verified that the final key shows xdx. - ✅ **TEST_SELECTION_SHIFT ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600711550))**: Verified that the pressing shift shows abcx with bc still selected. - ✅ **TEST_TYPING_AUTOSCROLL ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602185878))**: Retested as per Josh's suggestion and here my observation: 1. Verified that the text is automatically scrolled so that the last three characters and the caret are fully visible. 2. Verified that the Keyboard is still visible at any point while typing in the input field. - ✅ **TEST_ATTACHMENT_API ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600711550))**: 1. Verified that the 'auto' attachment mode properly and automatically attached to each dynamically-added control. 2. Verified the 'manual' attachment mode results in a page with no KMW-activated controls. 3. Verified that each 'attached' control functions as expected for the selected keyboard(s). 4. Verified that the KeymanWeb properly attaches to and detaches from each relevant type of control. Also, verified that the independent-keyboard management API functions correctly. - ✅ **TEST_NORMAL_USE ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600711550))**: Tested in the given test page and here is my observation : 1. Verified that the keyboard displays and works correctly when the first loaded up. - ✅ **TEST_ELEMENT_HOPPING ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600711550))**: Verified that the OSK remains visible if I jump to another page element and it is automatically hidden if I clicked on the blank area. - ✅ **TEST_SPECIFIC_KEYBOARDS ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600711550))**: Verified that the keyboard changes from one dynamic area to other and it is showing the expected keyboard layout. Seems to be working fine. - ✅ **TEST_JAPANESE_TYPING ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600711550))**: 1. Able to add japanese keyboard. 2. Able to select the second option to replace the existing context. - ✅ **TEST_JAPANESE_FOCUS ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600711550))**: 1. Verified that it is possible to see the japanese keyboard when I clicked either in text area or the input field. 2. If I clicked in the black area on the page, the keyboard disappeared. Seems to be working fine.
* ✅ GROUP_MACOS_SAFARI:
20 tests PASSED - ✅ **TEST_BASELINE_ADD_SIL_IPA ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598753548))**: Verified that the key sequence n> produced ŋ. ([notes](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598753548)) - ✅ **TEST_BASELINE_ADD_KM ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598753548))**: Verified that the Khmer_Basic keyboard was added. ([notes](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598753548)) - ✅ **TEST_BASELINE_ADD_KHMER_ANGKOR ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598753548))**: Verified that the Khmer_angkor keyboard was added. Able to see ស្រុក by typing key sequence s u j r k. Able to see that the reorder rule test, by hitting Backspace key. - ✅ **TEST_BASELINE_ADD_SPANISH ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598753548))**: Verified that the Spanish keyboard was added to the list. ([notes](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598753548)) - ✅ **TEST_BASELINE_SWEDISH ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598753548))**: Verified that the given key sequences shows the expected output. ([notes](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598753548)) - ✅ **TEST_SELECTION ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600949090))**: Tested in unminified Keymanweb test page and tested in both INPUT and TEXTAREA elements and here is my observations: 1. Verified that the output shows aqx. - ✅ **TEST_SELECTION_2 ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600949090))**: Verified thta the output after the final key shows aqx. - ✅ **TEST_CONTEXT_BASE ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600949090))**: Verified that the output finally shows !. - ✅ **TEST_CONTEXT_SELECTION ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600949090))**: Verified that the output shows abcd. - ✅ **TEST_CONTEXT_SELECTION_2 ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600949090))**: Verified that the final key shows !. - ✅ **TEST_CONTEXT_SELECTION_3 ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600949090))**: Verified that the final key shows !. - ✅ **TEST_CONTEXT_SELECTION_4 ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600949090))**: Verified that the final key shows xdx. - ✅ **TEST_SELECTION_SHIFT ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600949090))**: Verified that the pressing shift shows abcx with bc still selected. - ✅ **TEST_TYPING_AUTOSCROLL ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602185878))**: Retested as per Josh's suggestion and here my observation: 1. Verified that the text is automatically scrolled so that the last three characters and the caret are fully visible. 2. Verified that the Keyboard is still visible at any point while typing in the input field. - ✅ **TEST_ATTACHMENT_API ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600949090))**: 1. Verified that the 'auto' attachment mode properly and automatically attached to each dynamically-added control. 2. Verified the 'manual' attachment mode results in a page with no KMW-activated controls. 3. Verified that each 'attached' control functions as expected for the selected keyboard(s). 4. Verified that the KeymanWeb properly attaches to and detaches from each relevant type of control. Also, verified that the independent-keyboard management API functions correctly. - ✅ **TEST_NORMAL_USE ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600949090))**: Tested in the given test page and here is my observation : 1. Verified that the keyboard displays and works correctly when the first loaded up. - ✅ **TEST_ELEMENT_HOPPING ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600949090))**: Verified that the OSK remains visible if I jump to another page element and it is automatically hidden if I clicked on the blank area. - ✅ **TEST_SPECIFIC_KEYBOARDS ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600949090))**: Verified that the keyboard changes from one dynamic area to other and it is showing the expected keyboard layout. Seems to be working fine. - ✅ **TEST_JAPANESE_TYPING ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600949090))**: 1. Able to add japanese keyboard. 2. Able to select the second option to replace the existing context. - ✅ **TEST_JAPANESE_FOCUS ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1600949090))**: 1. Verified that it is possible to see the japanese keyboard when I clicked either in text area or the input field. 2. If I clicked in the black area on the page, the keyboard disappeared. Seems to be working fine.
* ✅ GROUP_MACOS_CHROME:
20 tests PASSED - ✅ **TEST_BASELINE_ADD_SIL_IPA ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598840612))**: Verified that the key sequence n> produced ŋ. ([notes](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598840612)) - ✅ **TEST_BASELINE_ADD_KM ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598840612))**: Verified that the Khmer_Basic keyboard was added. ([notes](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598840612)) - ✅ **TEST_BASELINE_ADD_KHMER_ANGKOR ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598840612))**: Verified that the Khmer_angkor keyboard was added. Able to see ស្រុក by typing key sequence s u j r k. Able to see that the reorder rule test, by hitting Backspace key. - ✅ **TEST_BASELINE_ADD_SPANISH ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598840612))**: Verified that the Spanish keyboard was added to the list. ([notes](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598840612)) - ✅ **TEST_BASELINE_SWEDISH ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598840612))**: Verified that the given key sequences shows the expected output. ([notes](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598840612)) - ✅ **TEST_SELECTION ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602322212))**: Tested in unminified Keymanweb test page and tested in both INPUT and TEXTAREA elements and here is my observations: 1. Verified that the output shows aqx. - ✅ **TEST_SELECTION_2 ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602322212))**: Verified that the output after the final key shows aqx. - ✅ **TEST_CONTEXT_BASE ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602322212))**: Verified that the output finally shows !. - ✅ **TEST_CONTEXT_SELECTION ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602322212))**: Verified that the output shows abcd. - ✅ **TEST_CONTEXT_SELECTION_2 ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602322212))**: Verified that the final key shows !. - ✅ **TEST_CONTEXT_SELECTION_3 ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602322212))**: Verified that the final key shows !. - ✅ **TEST_CONTEXT_SELECTION_4 ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602322212))**: Verified that the final key shows xdx. - ✅ **TEST_SELECTION_SHIFT ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602322212))**: Verified that the pressing shift shows abcx with bc still selected. - ✅ **TEST_TYPING_AUTOSCROLL ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602322212))**: 1. Verified that the text is automatically scrolled so that the last three characters and the caret are fully visible. 2. Verified that the Keyboard is still visible at any point while typing in the input field. - ✅ **TEST_ATTACHMENT_API ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602322212))**: 1. Verified that the 'auto' attachment mode properly and automatically attached to each dynamically-added control. 2. Verified the 'manual' attachment mode results in a page with no KMW-activated controls. 3. Verified that each 'attached' control functions as expected for the selected keyboard(s). 4. Verified that the KeymanWeb properly attaches to and detaches from each relevant type of control. Also, verified that the independent-keyboard management API functions correctly. - ✅ **TEST_NORMAL_USE ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602322212))**: Tested in the given test page and here is my observation : 1. Verified that the keyboard displays and works correctly when the first loaded up. - ✅ **TEST_ELEMENT_HOPPING ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602322212))**: Verified that the OSK remains visible if I jump to another page element and it is automatically hidden if I clicked on the blank area. - ✅ **TEST_SPECIFIC_KEYBOARDS ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602322212))**: Verified that the keyboard changes from one dynamic area to other and it is showing the expected keyboard layout. Seems to be working fine. - ✅ **TEST_JAPANESE_TYPING ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602322212))**: 1. Able to add japanese keyboard. 2. Able to select the second option to replace the existing context. - ✅ **TEST_JAPANESE_FOCUS ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602322212))**: 1. Verified that it is possible to see the japanese keyboard when I clicked either in text area or the input field. 2. If I clicked in the black area on the page, the keyboard disappeared. Seems to be working fine.
* ✅ GROUP_MACOS_FIREFOX:
20 tests PASSED - ✅ **TEST_BASELINE_ADD_SIL_IPA ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598840612))**: Verified that the key sequence n> produced ŋ. - ✅ **TEST_BASELINE_ADD_KM ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598840612))**: Verified that the Khmer_Basic keyboard was added. - ✅ **TEST_BASELINE_ADD_KHMER_ANGKOR ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598840612))**: Verified that the Khmer_angkor keyboard was added. Able to see ស្រុក by typing key sequence s u j r k. Able to see that the reorder rule test, by hitting Backspace key. - ✅ **TEST_BASELINE_ADD_SPANISH ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598840612))**: Verified that the Spanish keyboard was added to the list. ([notes](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598840612)) - ✅ **TEST_BASELINE_SWEDISH ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598840612))**: Verified that the given key sequences shows the expected output. ([notes](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598840612)) - ✅ **TEST_SELECTION ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602473078))**: Tested in unminified Keymanweb test page and tested in both INPUT and TEXTAREA elements and here is my observations: 1. Verified that the output shows aqx. - ✅ **TEST_SELECTION_2 ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602473078))**: Verified that the output after the final key shows aqx. - ✅ **TEST_CONTEXT_BASE ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602473078))**: Verified that the output finally shows !. - ✅ **TEST_CONTEXT_SELECTION ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602473078))**: Verified that the output shows abcd. - ✅ **TEST_CONTEXT_SELECTION_2 ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602473078))**: Verified that the final key shows !. - ✅ **TEST_CONTEXT_SELECTION_3 ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602473078))**: Verified that the final key shows !. - ✅ **TEST_CONTEXT_SELECTION_4 ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602473078))**: Verified that the final key shows xdx. - ✅ **TEST_SELECTION_SHIFT ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602473078))**: Verified that the pressing shift shows abcx with bc still selected. - ✅ **TEST_TYPING_AUTOSCROLL ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602473078))**: 1. Verified that the text is automatically scrolled so that the last three characters and the caret are fully visible. 2. Verified that the Keyboard is still visible at any point while typing in the input field. - ✅ **TEST_ATTACHMENT_API ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602473078))**: 1. Verified that the 'auto' attachment mode properly and automatically attached to each dynamically-added control. 2. Verified the 'manual' attachment mode results in a page with no KMW-activated controls. 3. Verified that each 'attached' control functions as expected for the selected keyboard(s). 4. Verified that the KeymanWeb properly attaches to and detaches from each relevant type of control. Also, verified that the independent-keyboard management API functions correctly. - ✅ **TEST_NORMAL_USE ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602473078))**: Tested in the given test page and here is my observation : 1. Verified that the keyboard displays and works correctly when the first loaded up. - ✅ **TEST_ELEMENT_HOPPING ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602473078))**: Verified that the OSK remains visible if I jump to another page element and it is automatically hidden if I clicked on the blank area. - ✅ **TEST_SPECIFIC_KEYBOARDS ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602473078))**: Verified that the keyboard changes from one dynamic area to other and it is showing the expected keyboard layout. Seems to be working fine. - ✅ **TEST_JAPANESE_TYPING ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602473078))**: 1. Able to add japanese keyboard. 2. Able to select the second option to replace the existing context. - ✅ **TEST_JAPANESE_FOCUS ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602473078))**: 1. Verified that it is possible to see the japanese keyboard when I clicked either in text area or the input field. 2. If I clicked in the black area on the page, the keyboard disappeared. Seems to be working fine.
* ✅ GROUP_LINUX_FIREFOX:
20 tests PASSED - ✅ **TEST_BASELINE_ADD_SIL_IPA ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598640501))**: Verified that the key sequence n> produced ŋ. ([notes](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598640501)) - ✅ **TEST_BASELINE_ADD_KM ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598640501))**: Verified that the Khmer_Basic keyboard was added. ([notes](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598640501)) - ✅ **TEST_BASELINE_ADD_KHMER_ANGKOR ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598640501))**: Verified that the Khmer_angkor keyboard was added. Able to see ស្រុក by typing key sequence s u j r k. Able to see that the reorder rule test, by hitting Backspace key. - ✅ **TEST_BASELINE_ADD_SPANISH ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598640501))**: Verified that the Spanish keyboard was added to the list. ([notes](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598640501)) - ✅ **TEST_BASELINE_SWEDISH ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598640501))**: Verified that the given key sequences shows the expected output. ([notes](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1598640501)) - ✅ **TEST_SELECTION ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602168025))**: Tested in unminified Keymanweb test page and tested in both INPUT and TEXTAREA elements and here is my observations: 1. Verified that the output shows aqx. - ✅ **TEST_SELECTION_2 ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602168025))**: Verified that the output after the final key shows aqx. - ✅ **TEST_CONTEXT_BASE ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602168025))**: Verified that the output finally shows !. - ✅ **TEST_CONTEXT_SELECTION ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602168025))**: Verified that the output shows abcd. - ✅ **TEST_CONTEXT_SELECTION_2 ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602168025))**: Verified that the final key shows !. - ✅ **TEST_CONTEXT_SELECTION_3 ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602168025))**: Verified that the final key shows !. - ✅ **TEST_CONTEXT_SELECTION_4 ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602168025))**: Verified that the final key shows xdx. - ✅ **TEST_SELECTION_SHIFT ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602168025))**: Verified that the pressing shift shows abcx with bc still selected. - ✅ **TEST_TYPING_AUTOSCROLL ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602168025))**: 1. Verified that the text is automatically scrolled so that the last three characters and the caret are fully visible. 2. Verified that the Keyboard is still visible at any point while typing in the input field. - ✅ **TEST_ATTACHMENT_API ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602168025))**: 1. Verified that the 'auto' attachment mode properly and automatically attached to each dynamically-added control. 2. Verified the 'manual' attachment mode results in a page with no KMW-activated controls. 3. Verified that each 'attached' control functions as expected for the selected keyboard(s). 4. Verified that the KeymanWeb properly attaches to and detaches from each relevant type of control. Also, verified that the independent-keyboard management API functions correctly. - ✅ **TEST_NORMAL_USE ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602168025))**: Tested in the given test page and here is my observation : 1. Verified that the keyboard displays and works correctly when the first loaded up. - ✅ **TEST_ELEMENT_HOPPING ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602168025))**: Verified that the OSK remains visible if I jump to another page element and it is automatically hidden if I clicked on the blank area. - ✅ **TEST_SPECIFIC_KEYBOARDS ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602168025))**: Verified that the keyboard changes from one dynamic area to other and it is showing the expected keyboard layout. Seems to be working fine. - ✅ **TEST_JAPANESE_TYPING ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602168025))**: 1. Able to add japanese keyboard. 2. Able to select the second option to replace the existing context. - ✅ **TEST_JAPANESE_FOCUS ([PASSED](https://github.com/keymanapp/keyman/issues/9037#issuecomment-1602168025))**: 1. Verified that it is possible to see the japanese keyboard when I clicked either in text area or the input field. 2. If I clicked in the black area on the page, the keyboard disappeared. Seems to be working fine.

🟥 SUITE_TOUCH: Touch platform tests

Retesting Template ``` @keymanapp-test-bot retest SUITE_TOUCH GROUP_IPAD_SAFARI_TOUCH TEST_BASELINE_ADD_KHMER_ANGKOR GROUP_IPAD_SAFARI_HARDWARE TEST_BASELINE_ADD_KHMER_ANGKOR ```
bharanidharanj commented 11 months ago

SUITE_DESKTOP: Desktop Platforms

GROUP_WINDOWS_FIREFOX:

bharanidharanj commented 11 months ago

SUITE_DESKTOP: Desktop Platforms

GROUP_WINDOWS_CHROME:

bharanidharanj commented 11 months ago

SUITE_DESKTOP: Desktop Platforms

GROUP_LINUX_FIREFOX:

bharanidharanj commented 11 months ago

SUITE_DESKTOP: Desktop Platforms

GROUP_MACOS_SAFARI:

bharanidharanj commented 11 months ago

SUITE_DESKTOP: Desktop Platforms

GROUP_MACOS_CHROME:

GROUP_MACOS_FIREFOX:

bharanidharanj commented 11 months ago

SUITE_DESKTOP: Desktop Platforms

GROUP_WINDOWS_FIREFOX:

Shift_firefox

..inputfield

bharanidharanj commented 11 months ago

SUITE_DESKTOP: Desktop Platforms

GROUP_WINDOWS_FIREFOX:

bharanidharanj commented 11 months ago

SUITE_DESKTOP: Desktop Platforms

GROUP_WINDOWS_CHROME:

bharanidharanj commented 11 months ago

SUITE_DESKTOP: Desktop Platforms

GROUP_MACOS_SAFARI:

jahorton commented 11 months ago

@bharanidharanj

  • TEST_TYPING_AUTOSCROLL (FAILED): Verified that the text autoscroll is not working in INPUT field.

..inputfield

... but it did autoscroll. Note the left-hand side of the input field. I'm assuming that you just typed the word testing over and over again... so why is the first thing visible in the input field ting, not testing? It's because the first copy's tes got "autoscrolled" off the left-hand side.

image

Note how you can still see the caret at the end of the input field, too:

image

From the test's definition:

Verify that the text is automatically scrolled so that the last three characters and the caret (the thin, blinking | mark for text position) are visible.

Your ing is visible, as well as the caret. It totally PASSES.

bharanidharanj commented 11 months ago

@bharanidharanj

  • TEST_TYPING_AUTOSCROLL (FAILED): Verified that the text autoscroll is not working in INPUT field.

..inputfield

... but it did autoscroll. Note the left-hand side of the input field. I'm assuming that you just typed the word testing over and over again... so why is the first thing visible in the input field ting, not testing? It's because the first copy's tes got "autoscrolled" off the left-hand side.

image

Note how you can still see the caret at the end of the input field, too:

image

From the test's definition:

Verify that the text is automatically scrolled so that the last three characters and the caret (the thin, blinking | mark for text position) are visible.

Your ing is visible, as well as the caret. It totally PASSES.

@jahorton I thought after typing the last 3 characters the word 'testing' will jump into the next line (ie., move down to next line ..like in text area). Now, I can understand the procedure. Thanks for the Clarification. :-)

jahorton commented 11 months ago

@keymanapp-test-bot retest SUITE_DESKTOP TEST_TYPING_AUTOSCROLL (To reset the test that just got clarified)

bharanidharanj commented 11 months ago

SUITE_DESKTOP: Desktop Platforms

GROUP_LINUX_FIREFOX:

bharanidharanj commented 11 months ago

SUITE_DESKTOP: Desktop Platforms

GROUP_WINDOWS_FIREFOX:

GROUP_WINDOWS_CHROME:

GROUP_MACOS_SAFARI:

bharanidharanj commented 11 months ago

SUITE_DESKTOP: Desktop Platforms

GROUP_MACOS_CHROME:

bharanidharanj commented 11 months ago

SUITE_DESKTOP: Desktop Platforms

GROUP_MACOS_FIREFOX:

bharanidharanj commented 11 months ago

SUITE_TOUCH: Touch platform tests

GROUP_ANDROID_CHROME_TOUCH:

bharanidharanj commented 11 months ago

SUITE_TOUCH: Touch platform tests

GROUP_ANDROID_CHROME_HARDWARE:

bharanidharanj commented 11 months ago

SUITE_TOUCH: Touch platform tests

GROUP_IPHONE_SAFARI_TOUCH:

bharanidharanj commented 11 months ago

SUITE_TOUCH: Touch platform tests

GROUP_IPHONE_SAFARI_HARDWARE:

bharanidharanj commented 11 months ago

SUITE_TOUCH: Touch platform tests

GROUP_IPAD_SAFARI_TOUCH:

..Landscape

GROUP_IPAD_SAFARI_HARDWARE:

jahorton commented 11 months ago

OK... so the two test failures are because the tablet form-factor layout for khmer_angkor doesn't use subkeys to the same extent as the phone form-factor layout. I've gone ahead and adjusted the description accordingly.

Looks like everything else passed swimmingly, so... I think that means we're good to go.

jahorton commented 11 months ago

For updating the Platform Acceptance Test for Web wiki page:

jahorton commented 10 months ago

8560 has merged! 🎊

As this was a testing issue for that branch, we can retire this issue now.