MakaraSok commented 2 years ago

Keyman for iPhone and iPad Acceptance Test Procedures

These test procedures are to be run before moving from alpha to beta, or beta to stable, or before PRs are merged into stable branches.
Copy these tests into a new issue (for tier transitions) or a comment on the PR.
When annotating results, use > at the start of a new line under the checkbox to note the result. (For an example, see #3973).

User Testing

Gather Assets for Testing

[ ] Record device's iOS version
[ ] Ensure the device is properly configured for testing and is registered with TestFlight.

At this time, Keyman for iOS does not support external keyboard input.

Setup Steps

Uninstall previous version of Keyman on the device (on a simulator, "Erase All Content and Settings..." under Device menu)
Install test build IPA (on a simulator, "iOS Simulator Image")
Disable internet connectivity of the device
Start Keyman and select Add a keyboard for your language
Verify error message "Could not reach Keyman server!" or "The Internet connection appears to be offline." is displayed
Click OK to dismiss. Close Keyman app
On device, enable internet connectivity
Start Keyman
On initial Get Started menu, select "Enable Keyman as system-wide keyboard" and do any necessary system steps to enable Keyman

SUITE_INSPECT: Visual Inspection of master branch

TEST_BUILD_STATUS: Verify latest CI build of master is successful
TEST_VERIFY_HISTORY: Verify history.md contains all the current changes
TEST_VERIFY_UNIT_TESTS: Verify that all unit tests for iOS are currently passing.
- May be integrated with the first step above once our usual CI processes include the iOS unit tests.

SUITE_MENU_FUNCTIONALITY: Menu Functionality Tests, in-app

GROUP_IPHONE_PORTRAIT: portrait mode in iPhone
GROUP_IPHONE_LANDSCAPE: landscape mode in iPhone
GROUP_IPAD_PORTRAIT: portrait mode in iPad
GROUP_IPAD_LANDSCAPE: landscape mode in iPad

Test Cases

TEST_GET_STARTED: Get Started
- Verify touching Add a keyboard for your language pulls up the keyboard search
  - This should also be accessible as Settings > Installed Languages > +.
- Verify touching Enable Keyman as system-wide keyboard pulls up Keyman's menu within iOS settings. (11.0+ devices)
  - If older versions of iOS are supported, ensure that the help page for doing it manually is properly linked.
- Verify touching More info brings up an accurate version and the main table-of-contents help page.
  - This should also be accessible as Info from the main menu dropdown (on phones) or as the circled-i button (on tablets).
- Set Don't show again to checked, close and re-open Keyman, and verify Get Started menu does not appear
TEST_ADD_NEW_KEYBOARD: Add New Keyboard This menu is accessed via Get Started menu or Settings menu
- On the device, enable internet connectivity
- Verify a new keyboard can be downloaded and selected, say "US Basic"
- Return to the text input screen and confirm that it operates correctly.
- Without changing selected language, confirm that it can be cleanly deleted via the Settings menu.
- Confirm that another keyboard is correctly selected afterward.
TEST_ADD_NEW_KEYBOARD_FROM_FILE:
- On the device, go to keyman.com on Safari
- Search for "US Basic"
- scroll down to keyboard details and tap to download the keyboard package (i.e. .kmp file)
- open Files app and navigate to Download folder to find "basic_kbdus.kmp" and tap on it to start the installation processes
- Keyman app should be pulled up
- follow the screen to finish the keyboard installation
- verity that the keyboard is correctly installed and working as expected
TEST_SWITCH_KEYBOARD
- press on the globe key
- the keyboard menu should be shown
- press on a keyboard to switch to, say "EuroLatin (SIL)"
- confirm that "EuroLatin (SIL)" is now selected and ready to be used
- swich back to "US Basic" and confirm it does as expected
TEST_SHARE: Share
- Type and verify text can be copied and shared to external app
TEST_KEYMAN_BROWSER: Keyman Browser ###
- On default page, click on text field and set system keyboard to Keyman
- Verify can type with Keyman as system keyboard
- Verify that predictive suggestions are properly applied when selected (using sil_euro_latin + English)
- Close and reopen Keyman app
TEST_TEXT_SIZE: Text Size
- Verify text can be rescaled from Text Size 9 to 72
TEST_CLEAR_TEXT: Clear Text
- Verify text can be cleared
TEST_INFO: Info
- Verify that the Keyman iOS version is displayed; record the version
- Verify that the Info menu options matches that of the More Info... option from the Get Started menu option.
- Verify that the Keyman iOS version matches the version string seen at (Home Screen) > [iOS] Settings > Keyman.
TEST_SETTINGS: Settings
- Installed Languages ... Add Language
- Select an installed language ... Add (another) Keyboard
- Should automatically perform a filtered search based upon that language's BCP-47 code, i.e. for "English" it should be seen as shown in the screenshot below.
- Select an installed language ... Dictionary
- Turn on/off 'Enable Predictions' and validate each
- Turn on/off 'Enable Corrections' and validate each
- Validate that when both predictions and corrections are off, banner is not visible
- Add/Remove dictionaries - validate
- If multiple dictionaries are available, test swapping between them
TEST_EUROLATIN: English (Eurolatin) in-app
- Verify that the OSK appears and fills the width the bottom of the screen
- Verify long-press q key works
- Verify long-press k key works
  - Verify that any predictive suggestions generated feel 'reasonable' (based upon 'k', the selected subkey, or one of its neighbors)
- Verify uppercase layer can be selected via SHIFT
- Verify number layer can be selected via 123
- Verify long-press 1 key works
- Verify long-press 0 key works
- Verify backspace, space, and enter keys work

Note that EuroLatin2, a highly customized keyboard explicitly designed for mobile, is not found; hence EuroLatin (SIL) is used for testing this instead.

TEST_US_BASIC: English: US Basic in-app
- Verify that the US Basic keyboard can be downloaded through Settings > Installed Languages > English > +
- This should automatically bring up search results for English keyboards.
- When the package-installer launches, English should be the one pre-selected language.
- Install the package for both English and Tagalog by selecting both of them in the installation processes.
- Set English: US Basic as the active in-app keyboard.
- Verify that predictive text suggestions appear.
- Set Tagalog: US Basic as the active in-app keyboard.
- Verify that predictive text suggestions do not appear.
- Verify that long-press 123 key works, presenting options for a currency layer and a symbol layer.
- Select the currency layer, then press the £ key.
- Verify that the keyboard outputs correctly and returns to the default layer.
- Go to the symbol layer and press the © key.
- Verify that the keyboard outputs correctly and remains on the symbol layer.
- Revert to the default layer and ensure basic key inputs work.
- Long-press e on the default layer and select a subkey.
- Verify that the selected key produces the correct output.
- From the Settings > Languages > English > US Basic menu, follow the "Help link" and ensure it displays appropriate help.
- (Should work both online and offline)
- From the Settings > Languages > English > US Basic menu, scan the QR code with a phone and test that it links to the current version of that keyboard's public download page on keyman.com.
- Returning to the app, uninstall the US Basic keyboard via Settings for Tagalog.
- Set English: US Basic as the active in-app keyboard.
- Verify that the keyboard appears correctly and ensure basic key inputs work.
- This is to ensure that uninstalling for one language doesn't adversely affect installations of the same resource for another language.
- Uninstall the US Basic keyboard via Settings for English.

SUITE_SYSTEM_KEYBOARD:

GROUP_IPHONE_PORTRAIT: portrait mode in iPhone
GROUP_IPHONE_LANDSCAPE: landscape mode in iPhone
GROUP_IPAD_PORTRAIT: portrait mode in iPad
GROUP_IPAD_LANDSCAPE: landscape mode in iPad

Test the following after setting Keyman as a system keyboard.

Test Cases

TEST_BASIC_USAGE: ensure that the keyboards functions as expected on all layers. Please test on multiple keyboards, i.e. EuroLatin (SIL), Cameroon QWERTY keyboard and Khmer Angkor.
TEST_LONG_PRESS: ensure that longpress on all applicable layers are working as intended
TEST_GLOBE_KEY: ensure that a short press on the globe key switch to the next keyboard and a longpress on it open the keyboard menu where you can select a keyboard of your choice

SUITE_SWITCH_LOCALE

GROUP_IPHONE_PORTRAIT: portrait mode in iPhone
GROUP_IPHONE_LANDSCAPE: landscape mode in iPhone
GROUP_IPAD_PORTRAIT: portrait mode in iPad
GROUP_IPAD_LANDSCAPE: landscape mode in iPad

Test Cases

TEST_KM_LOCALE
- from System Preferences, switch the UI language to Khmer by adding it in Language & Region using +
- drag Khmer to the top of the list to set it as a primary UI language
- check the dropdown menu to see it in Khmer (there is a known issue on this though, cf. https://github.com/keymanapp/keyman/issues/6527)
- verify the UI language switch to Khmer
TEST_AM_LOCALE
- from System Preferences, switch the UI language to Amharic by adding it in Language & Region using +
- drag Amharic to the top of the list to set it as a primary UI language
- check the dropdown menu to see it in Amharic (there is a known issue on this though, cf. https://github.com/keymanapp/keyman/issues/6527)
- verify the UI language switch to Amharic

[TODO] SUITE_PREDICTIVE_TEXT: Predictive Text

keymanapp-test-bot[bot] commented 2 years ago

User Test Results

Test specification and instructions

🟩 SUITE_INSPECT: Visual Inspection of master branch

✅ TEST_BUILD_STATUS (PASSED): Tested this as per the instructions and it is showing the successful build in Green colour.
✅ TEST_VERIFY_HISTORY (PASSED): history to be checked live at the root of the branch being tested - keyman/HISTORY.md.
🟩 TEST_VERIFY_UNIT_TESTS (SKIPPED): Seems to be tested in developer systems.

✅ SUITE_MENU_FUNCTIONALITY: Menu Functionality Tests, in-app

48 tests in 4 groups PASSED

* ✅ GROUP_IPHONE_PORTRAIT: portrait mode in iPhone

12 tests PASSED

- ✅ **TEST_GET_STARTED ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1123718157))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected. - ✅ **TEST_ADD_NEW_KEYBOARD ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1123718157))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected. - ✅ **TEST_ADD_NEW_KEYBOARD_FROM_FILE ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1123718157))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected. - ✅ **TEST_SWITCH_KEYBOARD ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1123718157))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected. - ✅ **TEST_SHARE ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1123718157))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected. - ✅ **TEST_KEYMAN_BROWSER ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1123718157))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected. - ✅ **TEST_TEXT_SIZE ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1123718157))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected. - ✅ **TEST_CLEAR_TEXT ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1123718157))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected. - ✅ **TEST_INFO ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1123718157))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected. - ✅ **TEST_SETTINGS ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1123718157))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected. - ✅ **TEST_EUROLATIN ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1123718157))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected. - ✅ **TEST_US_BASIC ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1138071259))**: The keyboard was examined and the next layer for the currency key £ is numeric layer, not default layer.

* ✅ GROUP_IPHONE_LANDSCAPE: landscape mode in iPhone

12 tests PASSED

- ✅ **TEST_GET_STARTED ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1123768076))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected. - ✅ **TEST_ADD_NEW_KEYBOARD ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1123768076))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected. - ✅ **TEST_ADD_NEW_KEYBOARD_FROM_FILE ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1123768076))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected. - ✅ **TEST_SWITCH_KEYBOARD ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1123768076))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected. - ✅ **TEST_SHARE ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1123768076))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected. - ✅ **TEST_KEYMAN_BROWSER ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1123768076))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected. - ✅ **TEST_TEXT_SIZE ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1123768076))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected. - ✅ **TEST_CLEAR_TEXT ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1123768076))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected. - ✅ **TEST_INFO ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1123768076))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected. - ✅ **TEST_SETTINGS ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1123768076))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected. - ✅ **TEST_EUROLATIN ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1123768076))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected. - ✅ **TEST_US_BASIC ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1138071259))**: The keyboard was examined and the next layer for the currency key £ is numeric layer, not default layer.

* ✅ GROUP_IPAD_PORTRAIT: portrait mode in iPad

12 tests PASSED

- ✅ **TEST_GET_STARTED ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124799272))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected. - ✅ **TEST_ADD_NEW_KEYBOARD ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124799272))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected. - ✅ **TEST_ADD_NEW_KEYBOARD_FROM_FILE ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124799272))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected. - ✅ **TEST_SWITCH_KEYBOARD ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124799272))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected. - ✅ **TEST_SHARE ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124799272))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected. - ✅ **TEST_KEYMAN_BROWSER ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124799272))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected. - ✅ **TEST_TEXT_SIZE ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124799272))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected. - ✅ **TEST_CLEAR_TEXT ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124799272))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected. - ✅ **TEST_INFO ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124799272))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected. - ✅ **TEST_SETTINGS ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124799272))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected. - ✅ **TEST_EUROLATIN ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124799272))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected. - ✅ **TEST_US_BASIC ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1138071259))**: The keyboard was examined and the next layer for the currency key £ is numeric layer, not default layer.

* ✅ GROUP_IPAD_LANDSCAPE: landscape mode in iPad

12 tests PASSED

- ✅ **TEST_GET_STARTED ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124836623))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected. - ✅ **TEST_ADD_NEW_KEYBOARD ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124836623))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected. - ✅ **TEST_ADD_NEW_KEYBOARD_FROM_FILE ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124836623))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected. - ✅ **TEST_SWITCH_KEYBOARD ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124836623))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected. - ✅ **TEST_SHARE ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124836623))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected. - ✅ **TEST_KEYMAN_BROWSER ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124836623))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected. - ✅ **TEST_TEXT_SIZE ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124836623))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected. - ✅ **TEST_CLEAR_TEXT ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124836623))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected. - ✅ **TEST_INFO ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124836623))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected. - ✅ **TEST_SETTINGS ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124836623))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected. - ✅ **TEST_EUROLATIN ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124836623))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected. - ✅ **TEST_US_BASIC ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1138071259))**: The keyboard was examined and the next layer for the currency key £ is numeric layer, not default layer.

✅ SUITE_SYSTEM_KEYBOARD:

12 tests in 4 groups PASSED

* ✅ GROUP_IPHONE_PORTRAIT: portrait mode in iPhone

3 tests PASSED

- ✅ **TEST_BASIC_USAGE ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124629529))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected. - ✅ **TEST_LONG_PRESS ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124629529))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected. - ✅ **TEST_GLOBE_KEY ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124629529))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected.

* ✅ GROUP_IPHONE_LANDSCAPE: landscape mode in iPhone

3 tests PASSED

- ✅ **TEST_BASIC_USAGE ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124629529))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected. - ✅ **TEST_LONG_PRESS ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124629529))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected. - ✅ **TEST_GLOBE_KEY ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124629529))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected.

* ✅ GROUP_IPAD_PORTRAIT: portrait mode in iPad

3 tests PASSED

- ✅ **TEST_BASIC_USAGE ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124864940))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected. - ✅ **TEST_LONG_PRESS ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124864940))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected. - ✅ **TEST_GLOBE_KEY ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124864940))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected.

* ✅ GROUP_IPAD_LANDSCAPE: landscape mode in iPad

3 tests PASSED

- ✅ **TEST_BASIC_USAGE ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124864940))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected. - ✅ **TEST_LONG_PRESS ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124864940))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected. - ✅ **TEST_GLOBE_KEY ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124864940))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected.

✅ SUITE_SWITCH_LOCALE:

8 tests in 4 groups PASSED

* ✅ GROUP_IPHONE_PORTRAIT: portrait mode in iPhone

2 tests PASSED

- ✅ **TEST_KM_LOCALE ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1123926848))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected. - ✅ **TEST_AM_LOCALE ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1123926848))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected. ([notes](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1123926848))

* ✅ GROUP_IPHONE_LANDSCAPE: landscape mode in iPhone

2 tests PASSED

- ✅ **TEST_KM_LOCALE ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1123926848))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected. ([notes](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1123926848)) - ✅ **TEST_AM_LOCALE ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1123926848))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected.

* ✅ GROUP_IPAD_PORTRAIT: portrait mode in iPad

2 tests PASSED

- ✅ **TEST_KM_LOCALE ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124864940))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected. - ✅ **TEST_AM_LOCALE ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124864940))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected.

* ✅ GROUP_IPAD_LANDSCAPE: landscape mode in iPad

2 tests PASSED

- ✅ **TEST_KM_LOCALE ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124864940))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected. - ✅ **TEST_AM_LOCALE ([PASSED](https://github.com/keymanapp/keyman/issues/6521#issuecomment-1124864940))**: Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected.

MakaraSok commented 2 years ago

@keymanapp-test-bot retest all

bharanidharanj commented 2 years ago

SUITE_INSPECT: Visual Inspection of master branch

TEST_BUILD_STATUS (PASSED): Successfully installed Keyman 16.0.7-alpha build in iPhone 13 Pro Simulator in Mac OS.
TEST_VERIFY_HISTORY (FAILED): History File need to be updated.
TEST_VERIFY_UNIT_TESTS (SKIPPED): Seems to be tested by this on developer's system.

MakaraSok commented 2 years ago

@bharanidharanj please don't test this now.

bharanidharanj commented 2 years ago

@bharanidharanj please don't test this now.

@MakaraSok Okay.

bharanidharanj commented 2 years ago

@MakaraSok I have tested Keyman 15.0.232 beta build in Portrait mode in iPhone 13 Pro Simulator and here is my observations:

Version Number should be updated in the History page.
'Keyman' logo appears as a banner while testing Keyman as the System Keyboard.
QR Code is missing for Tagalog (US Basic) Keyboard.

Keyman Help:

Kayman Banner:

QR Code missing for US Basic (Tagalog) Keyboard:

bharanidharanj commented 2 years ago

@MakaraSok After changing UI locale to Khmer or Amharic, the corresponding UI appears correctly in the Keyman Keyboard Menu list. However, I noticed that the top row keys of Khmer Keyboard are partially appears in the In-App.

bharanidharanj commented 2 years ago

@MakaraSok Tested Keyman 15.0.232 beta build in Landscape mode in iPhone 13 Pro Simulator and here are my observations:

I noticed that the Predictive Text / Suggestions appears partially on the top of the banner.
While using Physical Keyboard device, the texts appears only in english and not changing to the corresponding Keyboard.
Keyman Logo appears in the Keyboard banner while using Keyman as System Keyboard.
QR Code is missing for the Tagalog (US Basic) Keyboard.

bharanidharanj commented 2 years ago

SUITE_MENU_FUNCTIONALITY: Menu Functionality Tests, in-app

GROUP_IPHONE_PORTRAIT: portrait mode in iPhone

TEST_GET_STARTED (FAILED): Tested this with the latest Keyman 15.0.235-beta build and I noticed that If I disable 'Don't show again' option, then restarting Keyman, the 'Get Started' dialog does not appear on the Screen.
TEST_ADD_NEW_KEYBOARD (PASSED): Able to add a new Keyboard and also able to delete it using Settings Option.
TEST_ADD_NEW_KEYBOARD_FROM_FILE (PASSED): Able to install a keyboard using .kmp file.
TEST_SWITCH_KEYBOARD (PASSED): Switching from one Keyboard to other using globe key is working as expected.
TEST_SHARE (PASSED): Able to share the text to some other app line Notepad.
TEST_KEYMAN_BROWSER (PASSED): Able to use the Keyman Keyboard in Keyman Browser.
TEST_TEXT_SIZE (PASSED): Able to change the Text size from 9 to 72.
TEST_CLEAR_TEXT (PASSED): Clear Text functionality is working as expected.
TEST_INFO (PASSED): Able to to see the installed Keyman Version in the Info page and it is also reflected in More Info page too.

Keyman Info:

TEST_SETTINGS (PASSED): Able to install or add a Language. Banner is visible If the Predictions / Corrections are enabled. And it is not visible if they are disabled. Able to add or remove dictionaries.
TEST_EUROLATIN (PASSED): Tested this with English-EuroLatin (SIL) Keyboard and it is working as expected.
TEST_US_BASIC (FAILED): Tested this with US_BASIC (English and Tagalok) Keyboard and I noticed that everything is working fine except the QR code functionality. ie., In US Basic menu, the QR code was missing.

bharanidharanj commented 2 years ago

SUITE_MENU_FUNCTIONALITY: Menu Functionality Tests, in-app

GROUP_IPHONE_LANDSCAPE: landscape mode in iPhone

TEST_GET_STARTED (FAILED): Tested this with the latest Keyman 15.0.235-beta build and I noticed that If I disable 'Don't show again' option, then restarting Keyman, the 'Get Started' dialog does not appear on the Screen.
TEST_ADD_NEW_KEYBOARD (PASSED): Able to add a new Keyboard and also able to delete it using Settings Option.
TEST_ADD_NEW_KEYBOARD_FROM_FILE (PASSED): Able to install a keyboard using .kmp file.
TEST_SWITCH_KEYBOARD (PASSED): Switching from one Keyboard to other using globe key is working as expected.
TEST_SHARE (PASSED): Able to share the text to some other app line Notepad.
TEST_KEYMAN_BROWSER (PASSED): Able to use the Keyman Keyboard in Keyman Browser.
TEST_TEXT_SIZE (PASSED): Able to change the Text size from 9 to 72.
TEST_CLEAR_TEXT (PASSED): Clear Text functionality is working as expected.
TEST_INFO (PASSED): Able to to see the installed Keyman Version in the Info page and it is also reflected in More Info page too.
TEST_SETTINGS (PASSED): Able to install or add a Language. Banner is visible If the Predictions / Corrections are enabled. And it is not visible if they are disabled. Able to add or remove dictionaries.
TEST_EUROLATIN (PASSED): Tested this with English-EuroLatin (SIL) Keyboard and it is working as expected.
TEST_US_BASIC (FAILED): Tested this with US_BASIC (English and Tagalok) Keyboard and I noticed that everything is working fine except the QR code functionality. ie., In US Basic menu, the QR code was missing.

bharanidharanj commented 2 years ago

SUITE_MENU_FUNCTIONALITY: Menu Functionality Tests, in-app

GROUP_IPAD_PORTRAIT: portrait mode in iPad

TEST_GET_STARTED (FAILED): Tested this with the latest Keyman 15.0.235-beta build and I noticed that If I disable 'Don't show again' option, then restarting Keyman, the 'Get Started' dialog does not appear on the Screen.
TEST_ADD_NEW_KEYBOARD (PASSED): Able to add a new Keyboard and also able to delete it using Settings Option.
TEST_ADD_NEW_KEYBOARD_FROM_FILE (PASSED): Able to install a keyboard using .kmp file.
TEST_SWITCH_KEYBOARD (PASSED): Switching from one Keyboard to other using globe key is working as expected.
TEST_SHARE (PASSED): Able to share the text to some other app line Notepad.
TEST_KEYMAN_BROWSER (PASSED): Able to use the Keyman Keyboard in Keyman Browser.
TEST_TEXT_SIZE (PASSED): Able to change the Text size from 9 to 72.
TEST_CLEAR_TEXT (PASSED): Clear Text functionality is working as expected.
TEST_INFO (PASSED): Able to to see the installed Keyman Version in the Info page and it is also reflected in More Info page too.
TEST_SETTINGS (PASSED): Able to install or add a Language. Banner is visible If the Predictions / Corrections are enabled. And it is not visible if they are disabled. Able to add or remove dictionaries.
TEST_EUROLATIN (PASSED): Tested this with English-EuroLatin (SIL) Keyboard and it is working as expected.
TEST_US_BASIC (FAILED): Tested this with US_BASIC (English and Tagalok) Keyboard and I noticed that everything is working fine except the QR code functionality. ie., In US Basic menu, the QR code was missing.

GROUP_IPAD_LANDSCAPE: landscape mode in iPad

TEST_GET_STARTED (FAILED): Tested this with the latest Keyman 15.0.235-beta build and I noticed that If I disable 'Don't show again' option, then restarting Keyman, the 'Get Started' dialog does not appear on the Screen.
TEST_ADD_NEW_KEYBOARD (PASSED): Able to add a new Keyboard and also able to delete it using Settings Option.
TEST_ADD_NEW_KEYBOARD_FROM_FILE (PASSED): Able to install a keyboard using .kmp file.
TEST_SWITCH_KEYBOARD (PASSED): Switching from one Keyboard to other using globe key is working as expected.
TEST_SHARE (PASSED): Able to share the text to some other app line Notepad.
TEST_KEYMAN_BROWSER (PASSED): Able to use the Keyman Keyboard in Keyman Browser.
TEST_TEXT_SIZE (PASSED): Able to change the Text size from 9 to 72.
TEST_CLEAR_TEXT (PASSED): Clear Text functionality is working as expected.
TEST_INFO (PASSED): Able to to see the installed Keyman Version in the Info page and it is also reflected in More Info page too.
TEST_SETTINGS (PASSED): Able to install or add a Language. Banner is visible If the Predictions / Corrections are enabled. And it is not visible if they are disabled. Able to add or remove dictionaries.
TEST_EUROLATIN (PASSED): Tested this with English-EuroLatin (SIL) Keyboard and it is working as expected.
TEST_US_BASIC (FAILED): Tested this with US_BASIC (English and Tagalok) Keyboard and I noticed that everything is working fine except the QR code functionality. ie., In US Basic menu, the QR code was missing.

bharanidharanj commented 2 years ago

SUITE_SYSTEM_KEYBOARD:

GROUP_IPHONE_PORTRAIT: portrait mode in iPhone

TEST_BASIC_USAGE (PASSED): Tested this with the recent Keyman 15.0.235-beta build and it seems to be working as expected.
TEST_LONG_PRESS (PASSED): Tested this with the recent Keyman 15.0.235-beta build and it seems to be working as expected.
TEST_GLOBE_KEY (PASSED): Tested this with the recent Keyman 15.0.235-beta build and it seems to be working as expected.

GROUP_IPHONE_LANDSCAPE: landscape mode in iPhone

TEST_BASIC_USAGE (PASSED): Tested this with the recent Keyman 15.0.235-beta build and it seems to be working as expected.
TEST_LONG_PRESS (PASSED): Tested this with the recent Keyman 15.0.235-beta build and it seems to be working as expected.
TEST_GLOBE_KEY (PASSED): Tested this with the recent Keyman 15.0.235-beta build and it seems to be working as expected.

bharanidharanj commented 2 years ago

SUITE_SWITCH_LOCALE:

GROUP_IPHONE_PORTRAIT: portrait mode in iPhone

TEST_KM_LOCALE (PASSED): Tested this with the recent Keyman 15.0.235-beta build and it seems to be working as expected.
TEST_AM_LOCALE (PASSED): Tested this with the recent Keyman 15.0.235-beta build and it seems to be working as expected.

GROUP_IPHONE_LANDSCAPE: landscape mode in iPhone

TEST_KM_LOCALE (PASSED): Tested this with the recent Keyman 15.0.235-beta build and it seems to be working as expected.
TEST_AM_LOCALE (PASSED): Tested this with the recent Keyman 15.0.235-beta build and it seems to be working as expected.

bharanidharanj commented 2 years ago

SUITE_SYSTEM_KEYBOARD:

GROUP_IPAD_PORTRAIT: portrait mode in iPad

TEST_BASIC_USAGE (PASSED): Tested this with the recent Keyman 15.0.235-beta build and it seems to be working as expected.
TEST_LONG_PRESS (PASSED): Tested this with the recent Keyman 15.0.235-beta build and it seems to be working as expected.
TEST_GLOBE_KEY (PASSED): Tested this with the recent Keyman 15.0.235-beta build and it seems to be working as expected.

GROUP_IPAD_LANDSCAPE: landscape mode in iPad

TEST_BASIC_USAGE (PASSED): Tested this with the recent Keyman 15.0.235-beta build and it seems to be working as expected.
TEST_LONG_PRESS (PASSED): Tested this with the recent Keyman 15.0.235-beta build and it seems to be working as expected.
TEST_GLOBE_KEY (PASSED): Tested this with the recent Keyman 15.0.235-beta build and it seems to be working as expected.

SUITE_SWITCH_LOCALE:

GROUP_IPAD_PORTRAIT: portrait mode in iPad

TEST_KM_LOCALE (PASSED): Tested this with the recent Keyman 15.0.235-beta build and it seems to be working as expected.
TEST_AM_LOCALE (PASSED): Tested this with the recent Keyman 15.0.235-beta build and it seems to be working as expected.

GROUP_IPAD_LANDSCAPE: landscape mode in iPad

TEST_KM_LOCALE (PASSED): Tested this with the recent Keyman 15.0.235-beta build and it seems to be working as expected.

TEST_AM_LOCALE (PASSED): Tested this with the recent Keyman 15.0.235-beta build and it seems to be working as expected.

MakaraSok commented 2 years ago

@keymanapp-test-bot retest SUITE_MENU_FUNCTIONALITY GROUP_IPHONE_PORTRAIT TEST_GET_STARTED TEST_US_BASIC, SUITE_MENU_FUNCTIONALITY GROUP_IPHONE_LANDSCAPE TEST_GET_STARTED TEST_US_BASIC

MakaraSok commented 2 years ago

@keymanapp-test-bot retest SUITE_MENU_FUNCTIONALITY GROUP_IPAD_PORTRAIT TEST_GET_STARTED TEST_US_BASIC, SUITE_MENU_FUNCTIONALITY GROUP_IPAD_LANDSCAPE TEST_GET_STARTED TEST_US_BASIC

MakaraSok commented 2 years ago

Please retest all with the build from https://github.com/keymanapp/keyman/pull/6552.

@keymanapp-test-bot retest all

bharanidharanj commented 2 years ago

SUITE_INSPECT: Visual Inspection of master branch

TEST_BUILD_STATUS (PASSED): Tested this as per the instructions and it is showing the successful build in Green colour.
TEST_VERIFY_HISTORY (FAILED): Tested this as per the instructions and it seems that the history file need to be updated.

MakaraSok commented 2 years ago

@bharanidharanj This is to remind us that the build to use for retesting is from this PR https://github.com/keymanapp/keyman/pull/6552.

The version number of Keyman for iOS installed has to be 15.0.238-beta or later. Please don't go for alpha just yet.

bharanidharanj commented 2 years ago

@bharanidharanj This is to remind us that the build to use for retesting is from this PR #6552.

The version number of Keyman for iOS installed has to be 15.0.238-beta or later. Please don't go for alpha just yet.

@MakaraSok Okay.

bharanidharanj commented 2 years ago

SUITE_MENU_FUNCTIONALITY: Menu Functionality Tests, in-app

GROUP_IPHONE_PORTRAIT: portrait mode in iPhone

TEST_GET_STARTED (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected.
TEST_ADD_NEW_KEYBOARD (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected.
TEST_ADD_NEW_KEYBOARD_FROM_FILE (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected.
TEST_SWITCH_KEYBOARD (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected.
TEST_SHARE (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected.
TEST_KEYMAN_BROWSER (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected.
TEST_TEXT_SIZE (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected.
TEST_CLEAR_TEXT (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected.
TEST_INFO (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected.
TEST_SETTINGS (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected.
TEST_EUROLATIN (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected.
TEST_US_BASIC (FAILED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it seems that after typing '£' key from the Currency layer, it does not return to the default layer. Instead of that it is showing the Symbol layer.

bharanidharanj commented 2 years ago

SUITE_MENU_FUNCTIONALITY: Menu Functionality Tests, in-app

GROUP_IPHONE_LANDSCAPE: landscape mode in iPhone

TEST_GET_STARTED (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected.
TEST_ADD_NEW_KEYBOARD (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected.
TEST_ADD_NEW_KEYBOARD_FROM_FILE (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected.
TEST_SWITCH_KEYBOARD (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected.
TEST_SHARE (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected.
TEST_KEYMAN_BROWSER (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected.
TEST_TEXT_SIZE (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected.
TEST_CLEAR_TEXT (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected.
TEST_INFO (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected.
TEST_SETTINGS (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected.
TEST_EUROLATIN (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected.
TEST_US_BASIC (FAILED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it seems that after typing '£' key from the Currency layer, it does not return to the default layer. Instead of that it is showing the Symbol layer.

bharanidharanj commented 2 years ago

SUITE_SWITCH_LOCALE:

GROUP_IPHONE_PORTRAIT: portrait mode in iPhone

TEST_KM_LOCALE (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected.
TEST_AM_LOCALE (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected.

GROUP_IPHONE_LANDSCAPE: landscape mode in iPhone

TEST_KM_LOCALE (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected.

TEST_AM_LOCALE (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected.

bharanidharanj commented 2 years ago

SUITE_SYSTEM_KEYBOARD:

GROUP_IPHONE_PORTRAIT: portrait mode in iPhone

TEST_BASIC_USAGE (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected.
TEST_LONG_PRESS (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected.
TEST_GLOBE_KEY (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected.

GROUP_IPHONE_LANDSCAPE: landscape mode in iPhone

TEST_BASIC_USAGE (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected.
TEST_LONG_PRESS (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected.
TEST_GLOBE_KEY (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPhone 13 Pro Simulator and it is working as expected.

bharanidharanj commented 2 years ago

SUITE_MENU_FUNCTIONALITY: Menu Functionality Tests, in-app

GROUP_IPAD_PORTRAIT: portrait mode in iPad

TEST_GET_STARTED (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected.
TEST_ADD_NEW_KEYBOARD (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected.
TEST_ADD_NEW_KEYBOARD_FROM_FILE (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected.
TEST_SWITCH_KEYBOARD (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected.
TEST_SHARE (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected.
TEST_KEYMAN_BROWSER (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected.
TEST_TEXT_SIZE (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected.
TEST_CLEAR_TEXT (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected.
TEST_INFO (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected.
TEST_SETTINGS (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected.
TEST_EUROLATIN (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected.
TEST_US_BASIC (FAILED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it seems that it does not return to the default layer after pressing '£' Key from the Currency layer. Instead of that it is showing Symbol layer.

bharanidharanj commented 2 years ago

SUITE_MENU_FUNCTIONALITY: Menu Functionality Tests, in-app

GROUP_IPAD_LANDSCAPE: landscape mode in iPad

TEST_GET_STARTED (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected.
TEST_ADD_NEW_KEYBOARD (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected.
TEST_ADD_NEW_KEYBOARD_FROM_FILE (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected.
TEST_SWITCH_KEYBOARD (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected.
TEST_SHARE (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected.
TEST_KEYMAN_BROWSER (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected.
TEST_TEXT_SIZE (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected.
TEST_CLEAR_TEXT (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected.
TEST_INFO (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected.
TEST_SETTINGS (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected.
TEST_EUROLATIN (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected.
TEST_US_BASIC (FAILED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it seems that it does not return to the default layer after pressing '£' Key from the Currency layer. Instead of that it is showing Symbol layer.

bharanidharanj commented 2 years ago

SUITE_SYSTEM_KEYBOARD:

GROUP_IPAD_PORTRAIT: portrait mode in iPad

TEST_BASIC_USAGE (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected.
TEST_LONG_PRESS (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected.
TEST_GLOBE_KEY (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected.

GROUP_IPAD_LANDSCAPE: landscape mode in iPad

TEST_BASIC_USAGE (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected.
TEST_LONG_PRESS (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected.
TEST_GLOBE_KEY (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected.

SUITE_SWITCH_LOCALE:

GROUP_IPAD_PORTRAIT: portrait mode in iPad

TEST_KM_LOCALE (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected.
TEST_AM_LOCALE (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected.

GROUP_IPAD_LANDSCAPE: landscape mode in iPad

TEST_KM_LOCALE (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected.
TEST_AM_LOCALE (PASSED): Tested this with Keyman 15.0.238-beta build as per the instructions in iPad Air (5th generation) Pro Simulator and it is working as expected.

bharanidharanj commented 2 years ago

SUITE_INSPECT: Visual Inspection of master branch

TEST_VERIFY_UNIT_TESTS (SKIPPED): Seems to be tested in developer systems.

MakaraSok commented 1 year ago

SUITE_INSPECT

TEST_VERIFY_HISTORY (PASSED): history to be checked live at the root of the branch being tested - keyman/HISTORY.md.

SUITE_MENU_FUNCTIONALITY

GROUP_IPHONE_PORTRAIT

TEST_US_BASIC (PASSED): The keyboard was examined and the next layer for the currency key £ is numeric layer, not default layer.

SUITE_MENU_FUNCTIONALITY

GROUP_IPHONE_LANDSCAPE

TEST_US_BASIC (PASSED): The keyboard was examined and the next layer for the currency key £ is numeric layer, not default layer.

SUITE_MENU_FUNCTIONALITY

GROUP_IPAD_PORTRAIT

TEST_US_BASIC (PASSED): The keyboard was examined and the next layer for the currency key £ is numeric layer, not default layer.

SUITE_MENU_FUNCTIONALITY

GROUP_IPAD_LANDSCAPE

TEST_US_BASIC (PASSED): The keyboard was examined and the next layer for the currency key £ is numeric layer, not default layer.

keymanapp / keyman

Keyman for iPhone and iPad - Regression Tests #6521

Keyman for iPhone and iPad Acceptance Test Procedures

User Testing

Gather Assets for Testing

Setup Steps

SUITE_INSPECT: Visual Inspection of master branch

SUITE_MENU_FUNCTIONALITY: Menu Functionality Tests, in-app

Test Cases

SUITE_SYSTEM_KEYBOARD:

SUITE_SWITCH_LOCALE

Test Cases

[TODO] SUITE_PREDICTIVE_TEXT: Predictive Text

User Test Results

🟩 SUITE_INSPECT: Visual Inspection of master branch

✅ SUITE_MENU_FUNCTIONALITY: Menu Functionality Tests, in-app

✅ SUITE_SYSTEM_KEYBOARD:

✅ SUITE_SWITCH_LOCALE:

SUITE_INSPECT: Visual Inspection of master branch

SUITE_MENU_FUNCTIONALITY: Menu Functionality Tests, in-app

GROUP_IPHONE_PORTRAIT: portrait mode in iPhone

SUITE_MENU_FUNCTIONALITY: Menu Functionality Tests, in-app

GROUP_IPHONE_LANDSCAPE: landscape mode in iPhone

SUITE_MENU_FUNCTIONALITY: Menu Functionality Tests, in-app

GROUP_IPAD_PORTRAIT: portrait mode in iPad

GROUP_IPAD_LANDSCAPE: landscape mode in iPad

SUITE_SYSTEM_KEYBOARD:

GROUP_IPHONE_PORTRAIT: portrait mode in iPhone

GROUP_IPHONE_LANDSCAPE: landscape mode in iPhone

SUITE_SWITCH_LOCALE:

GROUP_IPHONE_PORTRAIT: portrait mode in iPhone

GROUP_IPHONE_LANDSCAPE: landscape mode in iPhone

SUITE_SYSTEM_KEYBOARD:

GROUP_IPAD_PORTRAIT: portrait mode in iPad

GROUP_IPAD_LANDSCAPE: landscape mode in iPad

SUITE_SWITCH_LOCALE:

GROUP_IPAD_PORTRAIT: portrait mode in iPad

GROUP_IPAD_LANDSCAPE: landscape mode in iPad

SUITE_INSPECT: Visual Inspection of master branch

SUITE_MENU_FUNCTIONALITY: Menu Functionality Tests, in-app

GROUP_IPHONE_PORTRAIT: portrait mode in iPhone

SUITE_MENU_FUNCTIONALITY: Menu Functionality Tests, in-app

GROUP_IPHONE_LANDSCAPE: landscape mode in iPhone

SUITE_SWITCH_LOCALE:

GROUP_IPHONE_PORTRAIT: portrait mode in iPhone

GROUP_IPHONE_LANDSCAPE: landscape mode in iPhone

SUITE_SYSTEM_KEYBOARD:

GROUP_IPHONE_PORTRAIT: portrait mode in iPhone

GROUP_IPHONE_LANDSCAPE: landscape mode in iPhone

SUITE_MENU_FUNCTIONALITY: Menu Functionality Tests, in-app

GROUP_IPAD_PORTRAIT: portrait mode in iPad

SUITE_MENU_FUNCTIONALITY: Menu Functionality Tests, in-app

GROUP_IPAD_LANDSCAPE: landscape mode in iPad

SUITE_SYSTEM_KEYBOARD:

GROUP_IPAD_PORTRAIT: portrait mode in iPad

GROUP_IPAD_LANDSCAPE: landscape mode in iPad

SUITE_SWITCH_LOCALE:

GROUP_IPAD_PORTRAIT: portrait mode in iPad

GROUP_IPAD_LANDSCAPE: landscape mode in iPad

SUITE_INSPECT: Visual Inspection of master branch

SUITE_INSPECT

SUITE_MENU_FUNCTIONALITY

GROUP_IPHONE_PORTRAIT

SUITE_MENU_FUNCTIONALITY

GROUP_IPHONE_LANDSCAPE

SUITE_MENU_FUNCTIONALITY

GROUP_IPAD_PORTRAIT

SUITE_MENU_FUNCTIONALITY

GROUP_IPAD_LANDSCAPE