bushnicoleVA
commented
8 months ago As discussed in the staging review, here is a screenshot of the chat conversation for a user who has no claims (this is the local development environment and does not reflect current styles for the Chatbot)
VFS Product information
VFS team name
Virtual Agent Chatbot
Product name
Chatbot
Feature name
Benefits Microservices - Claims Status Flow
GitHub label for team
virtual-agent
GitHub label for product
va-virtual-agent
GitHub label for feature
claims_v2
Public DSVA Slack channel for VFS team
va-chatbot-claims
Kickoff questions
Toggle kickoff questions
### When did/will you start working on this product/feature? 12/11/2023 ### Will your work result in visible changes to the user experience? Yes ### Are you doing research with VA.gov users? Yes ### Will your work involve changes to... Tools, applications and dynamic pages ### Does your product/feature have Google Analytics tracking and a KPI dashboard in Domo? Yes ### Do you need to capture any additional analytics or metrics? Yes ### Product outline https://github.com/department-of-veterans-affairs/va.gov-team/blob/master/products/virtual-agent/product/claims-status-initiative-brief.md ### Verify all relevant materials provided to Governance Team - [X] I have provided all relevant and up-to-date links, screenshots, images, designs, etc. of the as-is version of the product ### Add the GitHub labels for your team, product, and feature to this ticket. - [X] I acknowledge that I must add the GitHub labels for my team, product, and feature to this ticket. ### Notify the Collaboration Cycle team of this ticket in your team's public Slack channel. - [X] I acknowledge that I must notify the Governance team by completing the Collab Cycle Kickoff workflow in my team's Slack channel after submitting this issue. This can be completed by typing "/collab cycle" and selecting the kickoff workflow. - Kickoff Slack Thread with VFS team: [Kickoff thread](https://dsva.slack.com/archives/G01DXP10GCA/p1710174705052109)Recommended Collaboration Cycle touchpoints
Design Intent
Toggle Design Intent instructions
#### Before the meeting ##### VFS team actions - [ ] Review [Design Intent Guidance](https://depo-platform-documentation.scrollhelp.site/collaboration-cycle/design-intent) to understand what this touchpoint involves. - [ ] Schedule your Design Intent (with at least 2 business days lead time from now): - Open the [Calendly design intent calendar](https://calendly.com/collaboration-cycle/design-intent-or-midpoint-review) - Select a date and time and click "Confirm" - Add your name and email - Click "Add Guests" and enter the email addresses for VFS team attendees - Click "Schedule Event" - [ ] Link all artifacts in the `Design Intent artifacts for review` section below at least two business days before the scheduled Design Intent. Please don't add artifacts in the comments section. **Design Intent artifacts for review** [See guidance on Design Intent artifacts.](https://depo-platform-documentation.scrollhelp.site/collaboration-cycle/design-intent#Designintent-Artifacts) Governance Team feedback is based on the artifacts provided here as well as information provided during the meeting. Please provide links to artifacts **at least two business days** before the scheduled meeting. The Benefits Micro-Services team has the solidified Claims Status flow for Chatbot built into the Figma board. The low-fidelity wireframe flows and content mapping exist in Mural but those do not represent the most updated build as represented in Figma. The Claims Flow and Content Mapping can be used as reference points as part of where we started and the Figma board represents where we are now. Please see the artifacts below: - [Claims Status Flow V2 in Mural Board](https://app.mural.co/t/bahdigitalexperience6902/m/bahdigitalexperience6902/1701799055287/d5c1955ce52357dc4ab722475e0e4b897d744a97?wid=0-1704219014744&outline=open) - [Content Mapping of Flow in Mural Board](https://app.mural.co/t/bahdigitalexperience6902/m/bahdigitalexperience6902/1701799055287/d5c1955ce52357dc4ab722475e0e4b897d744a97?wid=0-1704219074635&outline=open) - [Claims Status Flow Figma High Fidelity Prototype](https://www.figma.com/file/Zt0srMa4SNohWlGbBJmfzT/Chat-bot-claims?type=design&node-id=412%3A3359&mode=design&t=sXB8fCRH4macOhgJ-1) - [Research & Test Plan](https://app.mural.co/t/bahdigitalexperience6902/m/bahdigitalexperience6902/1701799055287/d5c1955ce52357dc4ab722475e0e4b897d744a97?wid=0-1704219304672&outline=open) Multiple Claims Flow in Figma, screenshot:Sitewide CAIA Intake Request
Toggle Sitewide CAIA Intake Request
##### VFS actions - [x] Complete the [Sitewide CAIA intake request process](https://depo-platform-documentation.scrollhelp.site/collaboration-cycle/Sitewide-CAIA-intake-request.2124906551.html) - [x] Link to the Sitewide CAIA Intake Request ticket below - [CAIA Intake Request](https://github.com/department-of-veterans-affairs/va.gov-team/issues/78614)Research Review
Toggle Research Review
#### VFS actions - [ ] Complete the [research review process](https://depo-platform-documentation.scrollhelp.site/collaboration-cycle/Research-plan-review.1781891143.html)Midpoint Review
Toggle Midpoint Review
#### Before meeting ##### VFS actions Navigate to reference link: [Midpoint Review Guidance](https://depo-platform-documentation.scrollhelp.site/collaboration-cycle/midpoint-review) - [ ] Schedule your Midpoint Review when ready: - Open the [Calendly midpoint review calendar](https://calendly.com/collaboration-cycle/design-intent-or-midpoint-review) - Select a date and time and click “Confirm” - Add your name and email - Click "Add Guests" and enter the VFS meeting attendees email addresses - Invite all relevant VFS team members, including accessibility support, product owners, and other VA stakeholders - Click "Schedule Event" - [ ] Check this box if you'd like this review to be asynchronous (Please refer to the [Midpoint Review guidance](https://depo-platform-documentation.scrollhelp.site/collaboration-cycle/Midpoint-review.1781039167.html) for the difference between a synchronous meeting and an asynchronous review) - [ ] Link all artifacts **ONLY** in the Midpoint Review artifacts section below at least two days before the scheduled Midpoint Review. **Do NOT add artifacts to Comments section** **Midpoint Review artifacts** See Platform guidance on [Midpoint Review artifacts](https://depo-platform-documentation.scrollhelp.site/collaboration-cycle/midpoint-review#Midpointreview-Artifacts). Platform feedback is based solely on the artifacts provided, as reviewed during the two days before the Midpoint Review meeting. Any work not included in the artifacts below or any ongoing work taking place during the review period may not be reflected in that feedback. **Required artifacts** - [ ] Design prototype or high-fidelity mockup (must include mobile prototype/mockup) - Specify which pages are included in the review - [ ] Up to date user flow - [Guidance on user flows](https://github.com/department-of-veterans-affairs/va.gov-team/blob/master/products/information-architecture/standards/user-flow-guidance.md) - [ ] If working with [Sitewide CAIA](https://depo-platform-documentation.scrollhelp.site/collaboration-cycle/sitewide-content-and-ia-intake-request), link to CAIA intake ticket. **Not required, but nice to have artifacts** - [ ] Accessibility annotations included as part of your design - [ ] Research plan - Links to specific CAIA artifacts: - [ ] IA spec - [ ] Content source of truth - Any other artifacts you have so far ##### Platform actions - [ ] Slack thread with VFS team - [ ] Meeting date/time: #### After meeting ##### Platform actions * Accessibility * [ ] Feedback added to milestone * [ ] No feedback * Content * [ ] Feedback added to milestone * [ ] No feedback * Design * [ ] Feedback added to milestone * [ ] No feedback * IA * [ ] Feedback added to milestone * [ ] No feedback * [ ] Update this ticket with the Zoom recording - Recording link - Passcode: ##### VFS actions - [ ] Review feedback tickets and comment on the ticket if there are any questions or concernsAnalytics Request
Toggle Analytics Request
#### VFS actions - [x] Complete the [analytics request process](https://depo-platform-documentation.scrollhelp.site/collaboration-cycle/Analytics-request.1782120453.html) - [x] Link to the Analytics Implementation and QA Request ticket below - [Analytics Implementation Request](https://github.com/department-of-veterans-affairs/va.gov-team/issues/78656)Contact Center Review
Toggle Contact Center Review
#### VFS actions - [ ] Complete the [Contact Center review process](https://depo-platform-documentation.scrollhelp.site/collaboration-cycle/Contact-center-review.1782317061.html) - [ ] Link to the Contact Center review request ticket belowStaging Review
Toggle Staging Review
#### Before meeting ##### VFS actions - Navigate to reference link: [Staging Review Guidance](https://depo-platform-documentation.scrollhelp.site/collaboration-cycle/staging-review) - [ ] Schedule your Staging Review when ready: - Open the [Calendly staging review calendar](https://calendly.com/collaboration-cycle/staging-review) - Select a date and time and click “Confirm” - Add your name and email - Click "Add Guests" and enter the VFS meeting attendees email addresses - Invite all relevant VFS team members, including accessibility support, product owners, and other VA stakeholders - Click "Schedule Event" - [ ] If this product contains any [experimental design](https://design.va.gov/experimental-design/), add the `experimental-design` label and schedule a meeting with DSC to present the research findings. - [ ] Link all artifacts **ONLY** in the Staging Review artifacts section below at least four days before the scheduled Staging Review. **Do NOT add artifacts to Comments section** - [ ] I confirm the environment is available and test users have been provided. - [ ] Please verify your product information in the [Product Directory](https://depo-platform-documentation.scrollhelp.site/getting-started/vfs-product-directory). **Staging Review artifacts** See Platform guidance on [Staging Review artifacts](https://depo-platform-documentation.scrollhelp.site/collaboration-cycle/Staging-review.1810137181.html#Stagingreview-Artifacts). Platform findings are based solely on the staging URL and test users provided, as reviewed during the four days before the Staging Review meeting. Any test cases not covered or any ongoing work taking place during the review period may not be reflected in those findings. **Product artifacts** - [x] Staging URL https://staging.va.gov/contact-us/virtual-agent/ - [x] Specify which pages are included in the review - [x] Staging test user information vets.gov.user+14@gmail.com [Staging Account and Steps to Reproduce Claims Status Flow](https://github.com/department-of-veterans-affairs/va.gov-team-sensitive/blob/master/Administrative/vagov-users/staging-test-accounts-accessible-chatbot-claims-status-flow.md) **Note:** Please double-check that you've provided staging access information appropriate for testing the tool or feature. Don't put staging credentials in your va.gov-team ticket; store [test user information, passwords, and tasks](https://github.com/department-of-veterans-affairs/va.gov-team-sensitive/blob/master/Administrative/vagov-users/staging-test-accounts-accessible-example.md) in a .md file in the va.gov-team-sensitive repository. **Content artifacts** - [x] Please include a link to any [Sitewide CAIA](https://depo-platform-documentation.scrollhelp.site/collaboration-cycle/sitewide-content-and-ia-intake-request) feedback you received, including a content source of truth, any relevant static content page and entry point updates, and the intake form. [CAIA intake](https://github.com/department-of-veterans-affairs/va.gov-team/issues/78614) **IA artifacts** - [x] Please include a link to any [Sitewide CAIA](https://depo-platform-documentation.scrollhelp.site/collaboration-cycle/sitewide-caia-intake-request) feedback you received, including an IA review document or intake form. [CAIA intake](https://github.com/department-of-veterans-affairs/va.gov-team/issues/78614) **QA artifacts** An artifact that corresponds to each standard in the [QA Standards](https://depo-platform-documentation.scrollhelp.site/developer-docs/quality-assurance-standards). - [x] [Regression test plan](https://depo-platform-documentation.scrollhelp.site/developer-docs/quality-assurance-standards#QAstandards-regression-test-planRegressionTestPlan) - [Claims Status Flow - Test Cases](https://dvagov.sharepoint.com/:x:/r/sites/OmnichannelExperience/Shared%20Documents/VA%20Chatbot/Claims%20Chatbot/Tech/Staging%20Test%20Cases.xlsx?d=wf9ebb0545ef640ddbe22716e534c2e72&csf=1&web=1&e=e2d2WP) - [x] [Test plan](https://depo-platform-documentation.scrollhelp.site/developer-docs/quality-assurance-standards#QAstandards-test-planTestPlan) - [Claims Status Flow - Test Plan](https://dvagov.sharepoint.com/:w:/r/sites/OmnichannelExperience/Shared%20Documents/VA%20Chatbot/Claims%20Chatbot/Tech/Claims%20Status%20Flow%20-%20Staging%20Test%20Plan.docx?d=w7846f69dcff5479e867f87e2c47dc070&csf=1&web=1&e=cVSrqt) - [x] [Coverage for References](https://depo-platform-documentation.scrollhelp.site/developer-docs/quality-assurance-standards#QAstandards-traceability-reportsTraceabilityReports) - [Claims Status Flow - Test Plan](https://dvagov.sharepoint.com/:w:/r/sites/OmnichannelExperience/Shared%20Documents/VA%20Chatbot/Claims%20Chatbot/Tech/Claims%20Status%20Flow%20-%20Staging%20Test%20Plan.docx?d=w7846f69dcff5479e867f87e2c47dc070&csf=1&web=1&e=cVSrqt) - [x] [Summary(Defects) reports](https://depo-platform-documentation.scrollhelp.site/developer-docs/quality-assurance-standards#QAstandards-traceability-reportsTraceabilityReports) There have been 2 bugs and 9 support issues that have been reported and addressed: - https://app.zenhub.com/workspaces/chatbot---benefit-microservices-65b953e667bb36095e6fd305/issues/gh/department-of-veterans-affairs/va-virtual-agent-benefits/122 - https://app.zenhub.com/workspaces/chatbot---benefit-microservices-65b953e667bb36095e6fd305/issues/gh/department-of-veterans-affairs/va-virtual-agent-benefits/114 - https://github.com/department-of-veterans-affairs/va-virtual-agent-platform/issues/16 - https://github.com/department-of-veterans-affairs/va-virtual-agent-platform/issues/15 - https://github.com/department-of-veterans-affairs/va-virtual-agent-platform/issues/14 - https://github.com/department-of-veterans-affairs/va-virtual-agent-platform/issues/13 - https://github.com/department-of-veterans-affairs/va-virtual-agent-platform/issues/12 - https://github.com/department-of-veterans-affairs/va-virtual-agent-platform/issues/11 - https://github.com/department-of-veterans-affairs/va-virtual-agent-platform/issues/10 - https://github.com/department-of-veterans-affairs/va-virtual-agent-platform/issues/9 - https://github.com/department-of-veterans-affairs/va-virtual-agent-platform/issues/5 - [x] [E2E tests](https://depo-platform-documentation.scrollhelp.site/developer-docs/quality-assurance-standards#QAstandards-e2e-test-participationE2ETestParticipation) (provide a link to the product’s code) - [Claims Status Flow - Test Cases](https://dvagov.sharepoint.com/:x:/r/sites/OmnichannelExperience/Shared%20Documents/VA%20Chatbot/Claims%20Chatbot/Tech/Staging%20Test%20Cases.xlsx?d=wf9ebb0545ef640ddbe22716e534c2e72&csf=1&web=1&e=e2d2WP) - [x] [Code coverage](https://depo-platform-documentation.scrollhelp.site/developer-docs/quality-assurance-standards#QAstandards-unit-test-coverageUnitTestCoverage) (provide a link to the product’s code) - Code coverage has passed for code Pull Requests for development and staging environments. A list of PRs [here](https://github.com/department-of-veterans-affairs/va-virtual-agent/pulls?q=is%3Apr+author%3Abushnicoleva+), there is also a PR to address the adaptive card color [here](https://github.com/department-of-veterans-affairs/vets-website/pull/28831) - VA Claims Bot Tests [here](https://github.com/department-of-veterans-affairs/va-virtual-agent/tree/master/skills/va_claims_bot/tests) and va_claims_bot [here](https://github.com/department-of-veterans-affairs/va-virtual-agent/tree/master/skills/va_claims_bot) **Accessibility artifacts** - [x] [Completed accessibility testing artifact](https://github.com/department-of-veterans-affairs/va.gov-team/issues/new?assignees=briandeconinck&labels=a11y-testing&template=a11y-testing.yaml&title=Accessibility+Testing+for+%5BTeam+Name%2C+Product+Name%2C+Feature+Name%5D). For details, see [Prepare for an accessibility staging review](https://depo-platform-documentation.scrollhelp.site/collaboration-cycle/prepare-for-an-accessibility-staging-review). - [Claims Status Accessibility Testing Issue](https://github.com/department-of-veterans-affairs/va.gov-team/issues/79919) ##### Platform actions - [ ] Slack thread with VFS team: https://dsva.slack.com/archives/C05U8PUB7EZ/p1711556453972819 - [ ] Meeting date/time: April 2, 2024 at 11.30 AM ET #### After meeting ##### Platform actions - [ ] Update this ticket with the Zoom recording - [Recording link ](https://oddball-io.zoom.us/rec/share/Z0d3bo7_VKTeMBf2AhVdzVs0w5W236f6EIutCeo4cSdvuByjFCCpjC3cGzLOJsZV.n6eLl1swAp1Z8bLe) - Password: ucnE!^8 ##### VFS actions - [ ] Review the findings tickets and comment on the ticket if there are any questions or concerns - [ ] Close individual findings tickets when the issue has been resolved or validated by your Product Owner. If a team has additional questions or needs Platform help validating the issue, please comment on the issue ticket. - [ ] After launch, [request an accessibility audit from the VA 508 Office](https://depo-platform-documentation.scrollhelp.site/developer-docs/request-support-from-the-va-508-office#RequestsupportfromtheVA508office-AuditRequest). This is required even if no accessibility issues were found during the Staging Review. - [ ] Share ServiceNow ticket number here: ______ - [ ] Close ticket once Privacy, Security, Infrastructure Readiness Review has been completed, VA 508 Office audit is requested, and all other post-Staging actions are completePrivacy, Security, Infrastructure Readiness Review
Toggle Privacy, Security, Infrastructure Readiness Review
#### VFS actions - [ ] Complete the [Privacy, security, infrastructure readiness review process](https://depo-platform-documentation.scrollhelp.site/collaboration-cycle/Privacy-and-security-review.1782317101.html) - [ ] Link to the Readiness Review ticket below #### Platform actions - [ ] Privacy, security, infrastructure readiness review is complete