🤕 ALK0109 ERROR: Found potential accessibility issues on the direct-standard-fields screen. Details in alkiln-2024-06-03 at 00h14m34sUTC/I check the pages for accessibility-1717373681739/aXe_failure-direct-standard-fiel-1717373683581.json.
| checkboxes_other['checkbox_other_opt_1'] | true | |
| radio_yesno | False | false |
| radio_other | radio_other_opt_3 | |
| text_input | Regular text input field value | |
| textarea | Multiline text\narea value | |
| date_input | today | |
| combobox_input | Custom combobox option | |
| dropdown_test | dropdown_opt_2 | |
screen id: showifs
Accessibility on showifs passed!
screen id: object-checkboxes
🤕 ALK0109 ERROR: Found potential accessibility issues on the object-checkboxes screen. Details in alkiln-2024-06-03 at 00h14m34sUTC/I check the pages for accessibility-1717373681739/aXe_failure-object-checkboxes-1717373685239.json.
| object_checkboxes_test[\"obj_chkbx_opt_1\"] | True | |
| object_dropdown | obj_opt_2 | |
screen id: buttons-yesnomaybe
Accessibility on buttons-yesnomaybe passed!
| buttons_yesnomaybe | True | |
screen id: buttons-other
Accessibility on buttons-other passed!
| buttons_other | button_2 | |
screen id: button-continue
Accessibility on button-continue passed!
| button_continue | True | |
screen id: screen-features
Accessibility on screen-features passed!
Rows that got set:
And I get to the question id "screen features" with this data:
| var | value | trigger |
| button_continue | True | |
| buttons_other | button_2 | |
| buttons_yesnomaybe | True | |
| checkboxes_other['checkbox_other_opt_1'] | true | |
| combobox_input | Custom combobox option | |
| date_input | today | |
| double_quote_dict[\"double_quote_key\"]['dq_two'] | true | |
| dropdown_test | dropdown_opt_2 | |
| object_checkboxes_test[\"obj_chkbx_opt_1\"] | True | |
| object_dropdown | obj_opt_2 | |
| radio_other | radio_other_opt_3 | |
| radio_yesno | False | false |
| single_quote_dict['single_quote_key']['sq_two'] | true | |
| text_input | Regular text input field value | |
| textarea | Multiline text\narea value | |
Unused rows:
| object_select_test | obj_chkbx_opt_2 | |
🤕 ALK0092 ERROR: Accessibility standards tests failed. See information above.
≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡
🔎 Other scenarios that did not pass
≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡
―――――――――――――――――――――
Scenario: The Step is undefined
Tags: @error
―――――――――――――――――――――
Failures:
1) Scenario: The Step is undefined # docassemble/ALKilnTests/data/sources/fail.feature:4
✔ Before # ../../../../../opt/hostedtoolcache/node/18.20.3/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:111
? Given there is no such Step
Undefined. Implement with the following snippet:
Given('there is no such Step', function () {
// Write code here that turns the phrase above into concrete actions
return 'pending';
});
✔ After # ../../../../../opt/hostedtoolcache/node/18.20.3/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:1188
2) Scenario: I check the pages for accessibility (attempt 2) # docassemble/ALKilnTests/data/sources/observation_steps.feature:140
✔ Before # ../../../../../opt/hostedtoolcache/node/18.20.3/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:111
✔ Given I start the interview at "all_tests" # ../../../../../opt/hostedtoolcache/node/18.20.3/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:178
✔ And I check all pages for accessibility issues # ../../../../../opt/hostedtoolcache/node/18.20.3/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:830
✔ And I tap to continue # ../../../../../opt/hostedtoolcache/node/18.20.3/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:785
✔ Then I get to "screen features" with this data: # ../../../../../opt/hostedtoolcache/node/18.20.3/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:332
| var | value | trigger |
| double_quote_dict["double_quote_key"]['dq_two'] | true | |
| checkboxes_other['checkbox_other_opt_1'] | true | |
| combobox_input | Custom combobox option | |
| dropdown_test | dropdown_opt_2 | |
| radio_yesno | False | false |
| radio_other | radio_other_opt_3 | |
| object_checkboxes_test["obj_chkbx_opt_1"] | True | |
| object_dropdown | obj_opt_2 | |
| object_select_test | obj_chkbx_opt_2 | |
| single_quote_dict['single_quote_key']['sq_two'] | true | |
| text_input | Regular text input field value | |
| textarea | Multiline text\narea value | |
| date_input | today | |
| button_continue | True | |
| buttons_other | button_2 | |
| buttons_yesnomaybe | True | |
✖ After # ../../../../../opt/hostedtoolcache/node/18.20.3/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:1188
Error: 🤕 ALK0099 ERROR: Test failed. Expected status: PASSED. ALKiln's assessed status: FAILED. See the report for details.
at World. (/opt/hostedtoolcache/node/18.20.3/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:1394:11)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
Warnings:
1) Scenario: I check the pages for accessibility (attempt 1, retried) # docassemble/ALKilnTests/data/sources/observation_steps.feature:140
✔ Before # ../../../../../opt/hostedtoolcache/node/18.20.3/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:111
✔ Given I start the interview at "all_tests" # ../../../../../opt/hostedtoolcache/node/18.20.3/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:178
✔ And I check all pages for accessibility issues # ../../../../../opt/hostedtoolcache/node/18.20.3/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:830
✔ And I tap to continue # ../../../../../opt/hostedtoolcache/node/18.20.3/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:785
✔ Then I get to "screen features" with this data: # ../../../../../opt/hostedtoolcache/node/18.20.3/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:332
| var | value | trigger |
| double_quote_dict["double_quote_key"]['dq_two'] | true | |
| checkboxes_other['checkbox_other_opt_1'] | true | |
| combobox_input | Custom combobox option | |
| dropdown_test | dropdown_opt_2 | |
| radio_yesno | False | false |
| radio_other | radio_other_opt_3 | |
| object_checkboxes_test["obj_chkbx_opt_1"] | True | |
| object_dropdown | obj_opt_2 | |
| object_select_test | obj_chkbx_opt_2 | |
| single_quote_dict['single_quote_key']['sq_two'] | true | |
| text_input | Regular text input field value | |
| textarea | Multiline text\narea value | |
| date_input | today | |
| button_continue | True | |
| buttons_other | button_2 | |
| buttons_yesnomaybe | True | |
✖ After # ../../../../../opt/hostedtoolcache/node/18.20.3/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:1188
Error: 🤕 ALK0099 ERROR: Test failed. Expected status: PASSED. ALKiln's assessed status: FAILED. See the report for details.
at World. (/opt/hostedtoolcache/node/18.20.3/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:1394:11)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
An ALKiln test run failed. See the action at https://github.com/SuffolkLITLab/ALKiln/actions/runs/9342201568.
Results:
Assembly Line Kiln Automated Testing Report - Mon, 03 Jun 2024 00:14:34 GMT
≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡ 🤕 Failed scenarios ≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡
――――――――――――――――――――― Scenario: I check the pages for accessibility Tags: @observation @slow @o12 @accessibility @a11y ――――――――――――――――――――― Trying to load the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/all_tests.yml" Successfully found the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/all_tests.yml" screen id: upload-files screen id: group-of-complex-fields Accessibility on group-of-complex-fields passed! | single_quote_dict['single_quote_key']['sq_two'] | true | | | double_quote_dict[\"double_quote_key\"]['dq_two'] | true | | screen id: direct-standard-fields
🤕 ALK0109 ERROR: Found potential accessibility issues on the direct-standard-fields screen. Details in alkiln-2024-06-03 at 00h14m34sUTC/I check the pages for accessibility-1717373675508/aXe_failure-direct-standard-fiel-1717373677641.json. | checkboxes_other['checkbox_other_opt_1'] | true | | | radio_yesno | False | false | | radio_other | radio_other_opt_3 | | | text_input | Regular text input field value | | | textarea | Multiline text\narea value | | | date_input | today | | | combobox_input | Custom combobox option | | | dropdown_test | dropdown_opt_2 | | screen id: showifs Accessibility on showifs passed! screen id: object-checkboxes
🤕 ALK0109 ERROR: Found potential accessibility issues on the object-checkboxes screen. Details in alkiln-2024-06-03 at 00h14m34sUTC/I check the pages for accessibility-1717373675508/aXe_failure-object-checkboxes-1717373679440.json. | object_checkboxes_test[\"obj_chkbx_opt_1\"] | True | | | object_dropdown | obj_opt_2 | | screen id: buttons-yesnomaybe Accessibility on buttons-yesnomaybe passed! | buttons_yesnomaybe | True | | screen id: buttons-other Accessibility on buttons-other passed! | buttons_other | button_2 | | screen id: button-continue Accessibility on button-continue passed! | button_continue | True | | screen id: screen-features Accessibility on screen-features passed!
Rows that got set: And I get to the question id "screen features" with this data: | var | value | trigger | | button_continue | True | | | buttons_other | button_2 | | | buttons_yesnomaybe | True | | | checkboxes_other['checkbox_other_opt_1'] | true | | | combobox_input | Custom combobox option | | | date_input | today | | | double_quote_dict[\"double_quote_key\"]['dq_two'] | true | | | dropdown_test | dropdown_opt_2 | | | object_checkboxes_test[\"obj_chkbx_opt_1\"] | True | | | object_dropdown | obj_opt_2 | | | radio_other | radio_other_opt_3 | | | radio_yesno | False | false | | single_quote_dict['single_quote_key']['sq_two'] | true | | | text_input | Regular text input field value | | | textarea | Multiline text\narea value | | Unused rows: | object_select_test | obj_chkbx_opt_2 | |
🤕 ALK0092 ERROR: Accessibility standards tests failed. See information above.
――――――――――――――――――――― Scenario: I check the pages for accessibility Tags: @observation @slow @o12 @accessibility @a11y ――――――――――――――――――――― Trying to load the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/all_tests.yml" Successfully found the interview at "http://localhost/interview?new_session=1&i=docassemble.ALKilnTests%3Adata/questions/all_tests.yml" screen id: upload-files screen id: group-of-complex-fields Accessibility on group-of-complex-fields passed! | single_quote_dict['single_quote_key']['sq_two'] | true | | | double_quote_dict[\"double_quote_key\"]['dq_two'] | true | | screen id: direct-standard-fields
🤕 ALK0109 ERROR: Found potential accessibility issues on the direct-standard-fields screen. Details in alkiln-2024-06-03 at 00h14m34sUTC/I check the pages for accessibility-1717373681739/aXe_failure-direct-standard-fiel-1717373683581.json. | checkboxes_other['checkbox_other_opt_1'] | true | | | radio_yesno | False | false | | radio_other | radio_other_opt_3 | | | text_input | Regular text input field value | | | textarea | Multiline text\narea value | | | date_input | today | | | combobox_input | Custom combobox option | | | dropdown_test | dropdown_opt_2 | | screen id: showifs Accessibility on showifs passed! screen id: object-checkboxes
🤕 ALK0109 ERROR: Found potential accessibility issues on the object-checkboxes screen. Details in alkiln-2024-06-03 at 00h14m34sUTC/I check the pages for accessibility-1717373681739/aXe_failure-object-checkboxes-1717373685239.json. | object_checkboxes_test[\"obj_chkbx_opt_1\"] | True | | | object_dropdown | obj_opt_2 | | screen id: buttons-yesnomaybe Accessibility on buttons-yesnomaybe passed! | buttons_yesnomaybe | True | | screen id: buttons-other Accessibility on buttons-other passed! | buttons_other | button_2 | | screen id: button-continue Accessibility on button-continue passed! | button_continue | True | | screen id: screen-features Accessibility on screen-features passed!
Rows that got set: And I get to the question id "screen features" with this data: | var | value | trigger | | button_continue | True | | | buttons_other | button_2 | | | buttons_yesnomaybe | True | | | checkboxes_other['checkbox_other_opt_1'] | true | | | combobox_input | Custom combobox option | | | date_input | today | | | double_quote_dict[\"double_quote_key\"]['dq_two'] | true | | | dropdown_test | dropdown_opt_2 | | | object_checkboxes_test[\"obj_chkbx_opt_1\"] | True | | | object_dropdown | obj_opt_2 | | | radio_other | radio_other_opt_3 | | | radio_yesno | False | false | | single_quote_dict['single_quote_key']['sq_two'] | true | | | text_input | Regular text input field value | | | textarea | Multiline text\narea value | | Unused rows: | object_select_test | obj_chkbx_opt_2 | |
🤕 ALK0092 ERROR: Accessibility standards tests failed. See information above.
≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡ 🔎 Other scenarios that did not pass ≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡≡
――――――――――――――――――――― Scenario: The Step is undefined Tags: @error ―――――――――――――――――――――
Failures:
1) Scenario: The Step is undefined # docassemble/ALKilnTests/data/sources/fail.feature:4 ✔ Before # ../../../../../opt/hostedtoolcache/node/18.20.3/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:111 ? Given there is no such Step Undefined. Implement with the following snippet:
✔ After # ../../../../../opt/hostedtoolcache/node/18.20.3/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:1188
2) Scenario: I check the pages for accessibility (attempt 2) # docassemble/ALKilnTests/data/sources/observation_steps.feature:140 ✔ Before # ../../../../../opt/hostedtoolcache/node/18.20.3/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:111 ✔ Given I start the interview at "all_tests" # ../../../../../opt/hostedtoolcache/node/18.20.3/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:178 ✔ And I check all pages for accessibility issues # ../../../../../opt/hostedtoolcache/node/18.20.3/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:830 ✔ And I tap to continue # ../../../../../opt/hostedtoolcache/node/18.20.3/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:785 ✔ Then I get to "screen features" with this data: # ../../../../../opt/hostedtoolcache/node/18.20.3/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:332 | var | value | trigger | | double_quote_dict["double_quote_key"]['dq_two'] | true | | | checkboxes_other['checkbox_other_opt_1'] | true | | | combobox_input | Custom combobox option | | | dropdown_test | dropdown_opt_2 | | | radio_yesno | False | false | | radio_other | radio_other_opt_3 | | | object_checkboxes_test["obj_chkbx_opt_1"] | True | | | object_dropdown | obj_opt_2 | | | object_select_test | obj_chkbx_opt_2 | | | single_quote_dict['single_quote_key']['sq_two'] | true | | | text_input | Regular text input field value | | | textarea | Multiline text\narea value | | | date_input | today | | | button_continue | True | | | buttons_other | button_2 | | | buttons_yesnomaybe | True | | ✖ After # ../../../../../opt/hostedtoolcache/node/18.20.3/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:1188 Error: 🤕 ALK0099 ERROR: Test failed. Expected status: PASSED. ALKiln's assessed status: FAILED. See the report for details. at World. (/opt/hostedtoolcache/node/18.20.3/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:1394:11)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
Warnings:
1) Scenario: I check the pages for accessibility (attempt 1, retried) # docassemble/ALKilnTests/data/sources/observation_steps.feature:140 ✔ Before # ../../../../../opt/hostedtoolcache/node/18.20.3/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:111 ✔ Given I start the interview at "all_tests" # ../../../../../opt/hostedtoolcache/node/18.20.3/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:178 ✔ And I check all pages for accessibility issues # ../../../../../opt/hostedtoolcache/node/18.20.3/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:830 ✔ And I tap to continue # ../../../../../opt/hostedtoolcache/node/18.20.3/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:785 ✔ Then I get to "screen features" with this data: # ../../../../../opt/hostedtoolcache/node/18.20.3/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:332 | var | value | trigger | | double_quote_dict["double_quote_key"]['dq_two'] | true | | | checkboxes_other['checkbox_other_opt_1'] | true | | | combobox_input | Custom combobox option | | | dropdown_test | dropdown_opt_2 | | | radio_yesno | False | false | | radio_other | radio_other_opt_3 | | | object_checkboxes_test["obj_chkbx_opt_1"] | True | | | object_dropdown | obj_opt_2 | | | object_select_test | obj_chkbx_opt_2 | | | single_quote_dict['single_quote_key']['sq_two'] | true | | | text_input | Regular text input field value | | | textarea | Multiline text\narea value | | | date_input | today | | | button_continue | True | | | buttons_other | button_2 | | | buttons_yesnomaybe | True | | ✖ After # ../../../../../opt/hostedtoolcache/node/18.20.3/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:1188 Error: 🤕 ALK0099 ERROR: Test failed. Expected status: PASSED. ALKiln's assessed status: FAILED. See the report for details. at World. (/opt/hostedtoolcache/node/18.20.3/x64/lib/node_modules/@suffolklitlab/alkiln/lib/steps.js:1394:11)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
2 scenarios (1 failed, 1 undefined) 5 steps (1 undefined, 4 passed) 0m12.662s (executing steps: 0m12.570s)