ALKiln tests failed - Githubissues

An ALKiln test run failed. See the action at https://github.com/SuffolkLITLab/ALKiln/actions/runs/10287847977.

Results:

Assembly Line Kiln Automated Testing Report - Wed, 07 Aug 2024 16:19:06 GMT

≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡ 🤕 Failed scenarios ≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡

――――――――――――――― Scenario: I go to non-existent interview and only get that error Tags: @delete @da_api @fast @del4 @signin @sessions ――――――――――――――― Signed into http://localhost/user/sign-in successfully. Trying to load the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/nonexistent_interview.yml"

🤕 ALK0116 ERROR: On final attempt to load interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/nonexistent_interview.yml", got "ALKiln could not find any interview question page with the given information"

――――――――――――――― Scenario: Fail with no interview at fully arbitrary url Tags: @establishing @fast @failure @e8 @rfe8 @arbitraryurl ――――――――――――――― Trying to load the interview at "https://www.usa.gov/"

🤕 ALK0116 ERROR: On final attempt to load interview at "https://www.usa.gov/", got "ALKiln could not find any interview question page with the given information"

――――――――――――――― Scenario: I fail to sign in with wrong email and password Tags: @establishing @fast @e10 @signin @failure ―――――――――――――――

🤕 ALK0161 ERROR: The email address GitHub SECRET "WRONG_EMAIL" doesn't exist. Check for a typo and check your workflow file.

🤕 ALK0162 ERROR: The password GitHub SECRET "WRONG_PASSWORD" doesn't exist. Check for a typo and check your workflow file.

――――――――――――――― Scenario: I fail to sign in with wrong email and password Tags: @establishing @fast @e10 @signin @failure ―――――――――――――――

🤕 ALK0161 ERROR: The email address GitHub SECRET "WRONG_EMAIL" doesn't exist. Check for a typo and check your workflow file.

🤕 ALK0162 ERROR: The password GitHub SECRET "WRONG_PASSWORD" doesn't exist. Check for a typo and check your workflow file.

――――――――――――――― Scenario: Fail with missing secret and succeed with correct ones Tags: @interactive @fast @i2 @secret @failure ――――――――――――――― Trying to load the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/test_secret_vars.yml" Successfully found the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/test_secret_vars.yml" | first_text_entry | SECRET_VAR1 | | | second_text_entry | SECRET_VAR2 | |

🤕 ALK0121 ERROR: ALKiln could not find the GitHub secret "SECRET_NOT_THERE". Check for a typo and check your workflow file. Read more about using GitHub secrets in your workflow file at https://suffolklitlab.org/docassemble-AssemblyLine-documentation/docs/alkiln/writing#secrets.

――――――――――――――― Scenario: Fail with tab selector missing Tags: @interactive @i4 @tap_elements @tabs @failure ――――――――――――――― Trying to load the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/test_taps.yml" Successfully found the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/test_taps.yml"

🤕 ALK0107 ERROR: Couldn't find the tab with id "#Tests-not_there-tab" on the page, is there a typo?

――――――――――――――― Scenario: Fails as it doesn't try to 'continue' with a restart button Tags: @interactive @fast @i6 @failure ――――――――――――――― Trying to load the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/test_kickout.yml" Successfully found the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/test_kickout.yml" screen id: show-first-screen screen id: make-choice | user_choice | wrong | | screen id: kickout-screen

🤕 ALK0060 ERROR: The target id was "doesnt exist", but it took too long to try to reach it (over 0.16666666666666666 min). The test got stuck on "kickout-screen".

――――――――――――――― Scenario: I see user errors. Tags: @observation @fast @o2 ――――――――――――――― Trying to load the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/all_tests.yml" Successfully found the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/all_tests.yml" screen id: upload-files screen id: group-of-complex-fields

🤕 ALK0076 ERROR: No error message was found on the page

――――――――――――――― Scenario: I compare different PDFs Tags: @observation @o18 @compare_docs ――――――――――――――― Trying to load the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/test_pdf.yml" Successfully found the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/test_pdf.yml" screen id: proxy-vars | x[i].name.first | Proxyname1 diff | | screen id: signature screen id: proxy-vars | x[i].name.first | Proxyname2 diff | | screen id: signature Downloaded 2_signature.pdf (1555463 bytes) to alkiln-2024-08-07 at 16h19m06sUTC/I compare different PDFs-1723047750454 🔎 ALK0136 WARNING: ALKiln could not find "DOES_NOT_EXIST.pdf" in the folder(s) at "./docassemble/ALKilnTests/data/sources".

🤕 ALK0156 ERROR: Could not find the existing PDF at DOES_NOT_EXIST.pdf

🤕 ALK0157 ERROR: The PDFs were not the same. The new PDF added:

diff
diff

The new PDF removed:

You can see the full PDFs at ./docassemble/ALKilnTests/data/sources/linear_2_signature-Baseline.pdf and alkiln-2024-08-07 at 16h19m06sUTC/I compare different PDFs-1723047750454/2_signature.pdf

🤕 ALK0093 ERROR: PDF comparison failed 2 time(s) ――― Could not find the existing PDF at DOES_NOT_EXIST.pdf ――― The PDFs were not the same. The new PDF added:

diff
diff

The new PDF removed:

You can see the full PDFs at ./docassemble/ALKilnTests/data/sources/linear_2_signature-Baseline.pdf and alkiln-2024-08-07 at 16h19m06sUTC/I compare different PDFs-1723047750454/2_signature.pdf ―――

――――――――――――――― Scenario: Fail with error page from random input Tags: @random_input @fast @ri4 @random @failure ――――――――――――――― Trying to load the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/test_missing_var_error_screen.yml" Successfully found the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/test_missing_var_error_screen.yml" Testing interview with random input (in alkiln-2024-08-07 at 16h19m06sUTC/Fail with error page from random input-1723047763732/random1723047764053)

🤕 ALK0086 ERROR: The interview seemed to run into an error page after the page with the question id "null". See the picture of the page in "alkiln-2024-08-07 at 16h19m06sUTC/Fail with error page from random input-1723047763732/random1723047764053".

――――――――――――――― Scenario: Fail with wrong page id Tags: @reports @fast @rf3 @failure ――――――――――――――― Trying to load the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/all_tests.yml" Successfully found the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/all_tests.yml"

🤕 ALK0071 ERROR: The question id was supposed to be "wrong question id", but it is actually "upload-files".

――――――――――――――― Scenario: Fail with a missing phrase Tags: @reports @fast @rf4 @failure ――――――――――――――― Trying to load the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/all_tests.yml" Successfully found the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/all_tests.yml"

🤕 ALK0072 ERROR: The text "phrase missing" SHOULD be on this page, but it's NOT.

――――――――――――――― Scenario: Fail with incorrectly present phrase Tags: @reports @fast @rf5 @failure ――――――――――――――― Trying to load the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/all_tests.yml" Successfully found the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/all_tests.yml"

🤕 ALK0073 ERROR: The text "e" should NOT be on this page, but it IS here.

――――――――――――――― Scenario: Fail with missing element id Tags: @reports @fast @rf6 @failure ――――――――――――――― Trying to load the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/all_tests.yml" Successfully found the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/all_tests.yml"

🤕 ALK0074 ERROR: No element on this page has the ID "wrong element id".

――――――――――――――― Scenario: Fail with was unexpectedly not able to continue for invalid field input message Tags: @reports @fast @rf10 @failure ――――――――――――――― Trying to load the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/all_tests.yml" Successfully found the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/all_tests.yml" screen id: upload-files screen id: group-of-complex-fields screen id: direct-standard-fields

🤕 ALK0078 ERROR: User did not arrive at the next page.

――――――――――――――― Scenario: Fail with link text not visible Tags: @reports @fast @rf11 @failure ――――――――――――――― Trying to load the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/all_tests.yml" Successfully found the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/all_tests.yml"

🤕 ALK0079 ERROR: Cannot find a link with the text "Missing link".

――――――――――――――― Scenario: Fail with missing link with url Tags: @reports @fast @rf12 @failure ――――――――――――――― Trying to load the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/all_tests.yml" Successfully found the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/all_tests.yml"

🤕 ALK0080 ERROR: Cannot find a link to "http://missing-url.com".

🤕 ALK0081 ERROR: Cannot find a link with the text "Link to external page" leading to http://wrong-url.com.

🤕 ALK0082 ERROR: The link "Link to external page" does NOT open in the same window.

🤕 ALK0082 ERROR: The link "Link: reload the page" does NOT open in a new window.

――――――――――――――― Scenario: Fail with value not on page Tags: @reports @fast @rf17 @failure ――――――――――――――― Trying to load the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/all_tests.yml" Successfully found the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/all_tests.yml" screen id: upload-files

🤕 ALK0141 ERROR: In a linear Step all the values you give MUST be filled in, but ALKiln was unable to find a field on the page "upload-files" for the variable "missing_var_1" that could be set to "missing value 1". See this Scenario's HTML file for details.

――――――――――――――― Scenario: Fail with missing term with the given text Tags: @reports @fast @rf18 @failure ――――――――――――――― Trying to load the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/all_tests.yml" Successfully found the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/all_tests.yml"

🤕 ALK0151 ERROR: The term "wrong term" seems to be missing.

――――――――――――――― Scenario: Fail with cannot find missing document Tags: @reports @fast @rf19 @failure ――――――――――――――― Trying to load the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/all_tests.yml" Successfully found the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/all_tests.yml"

🤕 ALK0152 ERROR: "missing-doc.pdf" seems to be missing. Cannot find a link to that document.

――――――――――――――― Scenario: Fail with wrong interview YAML filename Tags: @reports @fast @rf20 @failure ――――――――――――――― Trying to load the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/wrong_yaml_filename.yml"

🤕 ALK0116 ERROR: On final attempt to load interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/wrong_yaml_filename.yml", got "ALKiln could not find any interview question page with the given information"

🤕 ALK0083 ERROR: The variable "dropdown_test" was not equal to the expected value on the "direct-standard-fields" screen. Check alkiln-2024-08-07 at 16h19m06sUTC/Fail with I can't match JSON page var to str-1723047822475/json_for-showifs-1723047824120.json to see the page's JSON variables.

――――――――――――――― Scenario: Fail with wrong email secret name Tags: @reports @fast @rf22 @signin @failure ―――――――――――――――

🤕 ALK0161 ERROR: The email address GitHub SECRET "WRONG_EMAIL_SECRET_NAME" doesn't exist. Check for a typo and check your workflow file.

――――――――――――――― Scenario: Fail with wrong password secret name Tags: @reports @fast @rf23 @signin @failure ―――――――――――――――

🤕 ALK0162 ERROR: The password GitHub SECRET "WRONG_PASSWORD_SECRET_NAME" doesn't exist. Check for a typo and check your workflow file.

――――――――――――――― Scenario: Fail with 2 wrong signin secret names Tags: @reports @fast @rf24 @signin @failure ―――――――――――――――

🤕 ALK0161 ERROR: The email address GitHub SECRET "WRONG_EMAIL_SECRET_NAME" doesn't exist. Check for a typo and check your workflow file.

🤕 ALK0162 ERROR: The password GitHub SECRET "WRONG_PASSWORD_SECRET_NAME" doesn't exist. Check for a typo and check your workflow file.

――――――――――――――― Scenario: Fail with could not find files Tags: @reports @fast @rf25 @upload @failure ――――――――――――――― Trying to load the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/all_tests.yml" Successfully found the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/all_tests.yml" screen id: upload-files 🔎 ALK0136 WARNING: ALKiln could not find "nonexistant1.pdf", "nonexistant2.pdf" in the folder(s) at "./docassemble/ALKilnTests/data/sources".

🤕 ALK0141 ERROR: In a linear Step all the values you give MUST be filled in, but ALKiln was unable to find a field on the page "upload-files" for the variable "upload_files_visible" that could be set to "nonexistant1.pdf, nonexistant2.pdf". See this Scenario's HTML file for details.

――――――――――――――― Scenario: Fail to find var while keeping value secret Tags: @reports @fast @rf26 @secret @failure ――――――――――――――― Trying to load the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/test_secret_vars.yml" Successfully found the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/test_secret_vars.yml"

🤕 ALK0141 ERROR: In a linear Step all the values you give MUST be filled in, but ALKiln was unable to find a field on the page "null" for the variable "missing_var" that could be set to "SECRET_FOR_MISSING_FIELD". See this Scenario's HTML file for details.

――――――――――――――― Scenario: Fail with missing docx Tags: @reports @fast @rf27 @failure ――――――――――――――― Trying to load the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/test_missing_docx.yml"

🤕 ALK0116 ERROR: On final attempt to load interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/test_missing_docx.yml", got "There was an error. Please contact the system administrator."

――――――――――――――― Scenario: Fail on unexpected status even when report is as expected Tags: @reports @rf28 @failure ――――――――――――――― Trying to load the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/AL_tests.yml" Successfully found the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/AL_tests.yml" 🔎 ALK0158 WARNING: The name "Uli Udo User Sampson NotASuffix" has more than 4 parts, but 4 is the maximum allowed. The test will set the name to "Uli Udo User NotASuffix". screen id: al-type-name-fields | users[0].name.first | Uli | | | users[0].name.middle | Udo | | | users[0].name.last | User | |

🤕 ALK0141 ERROR: In a linear Step all the values you give MUST be filled in, but ALKiln was unable to find a field on the page "al-type-name-fields" for the variable "users[0].name.suffix" that could be set to "NotASuffix". See this Scenario's HTML file for details.

――――――――――――――― Scenario: Fails when table has no header row and rows have only one column Tags: @story_tables_formats @table @fast @stf7 @failure ――――――――――――――― Trying to load the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/all_tests.yml" Successfully found the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/all_tests.yml"

🤕 ALK0120 ERROR: Your Story Table should have more than 1 columns. Take another look at Story Table documentation at https://suffolklitlab.org/docassemble-AssemblyLine-documentation/docs/alkiln/writing#story-table.

――――――――――――――― Scenario: Story table accidentally uses the opposite double or single quotes Tags: @story_tables @table @fast @st3 @quotes ――――――――――――――― Trying to load the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/all_tests.yml" Successfully found the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/all_tests.yml" screen id: upload-files screen id: group-of-complex-fields | single_quote_dict[\"single_quote_key\"]['sq_two'] | true | | | double_quote_dict['double_quote_key'][\"dq_two\"] | true | |

≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡ 🔎 Other scenarios that did not pass ≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡

――――――――――――――― Scenario: Fail with missing invalid answer message Tags: @reports @fast @rf8 @failure ――――――――――――――― Trying to load the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/all_tests.yml" Successfully found the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/all_tests.yml" screen id: upload-files screen id: group-of-complex-fields

Failures:

1) Scenario: I fail to sign in with wrong email and password (attempt 2) # docassemble/ALKilnTests/data/sources/establishing_steps.feature:76 ✔ Before # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:115 ✔ Given the final Scenario status should be "failed" # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:1187 ✔ Given the Scenario report should include: # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:1161 """ ALK0205 """ ✖ And I sign in with "WRONG_EMAIL", "WRONG_PASSWORD" # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:284 AssertionError: The email address GitHub SECRET "WRONG_EMAIL" doesn't exist. Check for a typo and check your workflow file.: expected undefined to not equal undefined at Object.sign_in (/opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/scope.js:3017:41) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async World. (/opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:301:3) ✖ After # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:1266 AssertionError: expected '\n―――――――――――――――\nScenario: I fail to sign in with wrong email and password\nTags: @establishing @fast @e10 @signin @failure\n―――――――――――――――\n\n🤕 ALK0161 ERROR: The email address GitHub SECRET "WRONG_EMAIL" doesn\'t exist. Check for a typo and check your workflow file.\n\n🤕 ALK0162 ERROR: The password GitHub SECRET "WRONG_PASSWORD" doesn\'t exist. Check for a typo and check your workflow file.\nFor security, ALKiln will avoid creating a picture of the page for this error. It\'s possible a secret is being used on this screen.\n\n-- Scenario Failed --\n' to include 'ALK0205' at Object.reportIncludesAllExpected (/opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/scope.js:3304:29) at World. (/opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:1349:60)

2) Scenario: I see user errors. (attempt 2) # docassemble/ALKilnTests/data/sources/observation_steps.feature:18 ✔ Before # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:115 ✔ Given I start the interview at "all_tests" # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:185 ✔ And I tap to continue # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:798 ✔ And I tap to continue # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:798 ✖ Then I will be told an answer is invalid # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:624 AssertionError: No error message was found on the page: expected false to be true

expected - actual
```
   -false
   +true

   at World.<anonymous> (/opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:630:42)
   at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
```
- When I tap to continue # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:798 ✖ After # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:1266 Error: 🤕 ALK0099 ERROR: Test FAILED. Expected status: PASSED. See the report for details. at World. (/opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:1505:11) at process.processTicksAndRejections (node:internal/process/task_queues:95:5)

3) Scenario: Fail with missing invalid answer message (attempt 2) # docassemble/ALKilnTests/data/sources/reports.feature:80 ✔ Before # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:115 ✔ Given the final Scenario status should be "failed" # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:1187 ✔ Given the Scenario report should include: # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:1161 """ No error message was found on the page """ ✔ And I start the interview at "all_tests" # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:185 ✔ And I tap to continue # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:798 ✔ And I tap to continue # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:798 ? Then tapping the continue button fails Undefined. Implement with the following snippet:

     Then('tapping the continue button fails', function () {
       // Write code here that turns the phrase above into concrete actions
       return 'pending';
     });

✖ After # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:1266 AssertionError: expected '\n―――――――――――――――\nScenario: Fail with missing invalid answer message\nTags: @reports @fast @rf8 @failure\n―――――――――――――――\nTrying to load the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/all_tests.yml"\nSuccessfully found the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/all_tests.yml"\nscreen id: upload-files\nscreen id: group-of-complex-fields\n' to include 'No error message was found on the page' at Object.reportIncludesAllExpected (/opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/scope.js:3304:29) at World. (/opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:1349:60) at process.processTicksAndRejections (node:internal/process/task_queues:95:5)

Warnings:

1) Scenario: I fail to sign in with wrong email and password (attempt 1, retried) # docassemble/ALKilnTests/data/sources/establishing_steps.feature:76 ✔ Before # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:115 ✔ Given the final Scenario status should be "failed" # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:1187 ✔ Given the Scenario report should include: # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:1161 """ ALK0205 """ ✖ And I sign in with "WRONG_EMAIL", "WRONG_PASSWORD" # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:284 AssertionError: The email address GitHub SECRET "WRONG_EMAIL" doesn't exist. Check for a typo and check your workflow file.: expected undefined to not equal undefined at Object.sign_in (/opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/scope.js:3017:41) at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async World. (/opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:301:3) ✖ After # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:1266 AssertionError: expected '\n―――――――――――――――\nScenario: I fail to sign in with wrong email and password\nTags: @establishing @fast @e10 @signin @failure\n―――――――――――――――\n\n🤕 ALK0161 ERROR: The email address GitHub SECRET "WRONG_EMAIL" doesn\'t exist. Check for a typo and check your workflow file.\n\n🤕 ALK0162 ERROR: The password GitHub SECRET "WRONG_PASSWORD" doesn\'t exist. Check for a typo and check your workflow file.\nFor security, ALKiln will avoid creating a picture of the page for this error. It\'s possible a secret is being used on this screen.\n\n-- Scenario Failed --\n' to include 'ALK0205' at Object.reportIncludesAllExpected (/opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/scope.js:3304:29) at World. (/opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:1349:60)

2) Scenario: I see user errors. (attempt 1, retried) # docassemble/ALKilnTests/data/sources/observation_steps.feature:18 ✔ Before # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:115 ✔ Given I start the interview at "all_tests" # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:185 ✔ And I tap to continue # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:798 ✔ And I tap to continue # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:798 ✖ Then I will be told an answer is invalid # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:624 AssertionError: No error message was found on the page: expected false to be true

expected - actual
```
   -false
   +true

   at World.<anonymous> (/opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:630:42)
   at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
```
- When I tap to continue # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:798 ✖ After # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:1266 Error: 🤕 ALK0099 ERROR: Test FAILED. Expected status: PASSED. See the report for details. at World. (/opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:1505:11) at process.processTicksAndRejections (node:internal/process/task_queues:95:5)

3) Scenario: Fail with missing invalid answer message (attempt 1, retried) # docassemble/ALKilnTests/data/sources/reports.feature:80 ✔ Before # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:115 ✔ Given the final Scenario status should be "failed" # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:1187 ✔ Given the Scenario report should include: # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:1161 """ No error message was found on the page """ ✔ And I start the interview at "all_tests" # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:185 ✔ And I tap to continue # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:798 ✔ And I tap to continue # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:798 ? Then tapping the continue button fails Undefined. Implement with the following snippet:

     Then('tapping the continue button fails', function () {
       // Write code here that turns the phrase above into concrete actions
       return 'pending';
     });

4) Scenario: I upload files with a table (attempt 1, retried) # docassemble/ALKilnTests/data/sources/story_tables.feature:87 ✖ Before # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:115 ProtocolError: Protocol error (Target.createTarget): Session with given id not found. at new Callback (/opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/node_modules/puppeteer-core/lib/cjs/puppeteer/common/Connection.js:62:35) at CallbackRegistry.create (/opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/node_modules/puppeteer-core/lib/cjs/puppeteer/common/Connection.js:108:26) at Connection._rawSend (/opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/node_modules/puppeteer-core/lib/cjs/puppeteer/common/Connection.js:224:26) at Connection.send (/opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/node_modules/puppeteer-core/lib/cjs/puppeteer/common/Connection.js:218:21) at CDPBrowser._createPageInContext (/opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/node_modules/puppeteer-core/lib/cjs/puppeteer/common/Browser.js:275:94) at CDPBrowserContext.newPage (/opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/node_modules/puppeteer-core/lib/cjs/puppeteer/common/Browser.js:525:78) at CDPBrowser.newPage (/opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/node_modules/puppeteer-core/lib/cjs/puppeteer/common/Browser.js:269:78) at World. (/opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:138:36) at process.processTicksAndRejections (node:internal/process/task_queues:95:5)

Given I start the interview at "all_tests" # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:185
And I get to "group of complex fields" with this data: # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:345 | var | value | trigger | | upload_files_visible | some_png_1.png, some_png_2.png | | | show_upload | True | | | upload_files_hidden | some_png_2.png | | ✖ After # ../../../../../opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:1266 TargetCloseError: Protocol error (Runtime.callFunctionOn): Session closed. Most likely the page has been closed. at CDPSessionImpl.send (/opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/node_modules/puppeteer-core/lib/cjs/puppeteer/common/Connection.js:429:35) at ExecutionContext._ExecutionContext_evaluate (/opt/hostedtoolcache/node/18.20.4/x64/lib/node_modules/@suffolklitlab/alkiln/node_modules/puppeteer-core/lib/cjs/puppeteer/common/ExecutionContext.js:244:46) at process.processTicksAndRejections (node:internal/process/task_queues:95:5)

97 scenarios (3 failed, 94 passed) 547 steps (2 failed, 1 undefined, 1 skipped, 543 passed) 5m35.083s (executing steps: 5m34.741s)

SuffolkLITLab / ALKiln

ALKiln tests failed #932

Results: