CMSgov / bluebutton-web-server

Blue Button API
https://sandbox.bluebutton.cms.gov
Other
40 stars 24 forks source link

jimfuqian/BB2-3276-Adjust-Splunk-Auth-Flow-Dashboard-Spanish-Lang-Stats #1217

Closed JFU-NAVA-PBC closed 3 months ago

JFU-NAVA-PBC commented 4 months ago

JIRA Ticket: BB2-3276 Also as a convenient bonus fix BB2-3277

User Story or Bug Summary:

Some previous work has been done such that: splunk/authorization_flow_dashboard.xml was updated with a placeholder of what would eventually be added to Splunk for Spanish Language tracking. The metric has since been added to the actual Splunk dashboard, although the details of how it is displayed has not been reviewed with the team, and may be out of sync with what is in the repo in the xml file. This task involves finalizing a landing spot for that metric in Splunk and making sure the xml file reflects any changes.

What Does This PR Do?

Modified splunk/authorization_flow_dashboard.xml:

  1. Added panel - make "Spanish Authorization Count" as a standalone stats panel in the same row as panel titled "Initial Authorization Request / Authorization Completed %"
  2. Added panel - a chart of percent : spanish auth request vs total auth request
  3. Remove the stats panel as step 13 of the AUTH FLOW (logically the language chosen during medicare login is not a step in the auth flow)

What Should Reviewers Watch For?

Checkout the dashboard here: [BB2 Authorization Flow Dashboard (BB2-3276)](https://splunk.cloud.cms.gov/en-US/app/cms_bbapi_landing_app/bb2_authorization_flow_dashboard

Note:

  1. There are references to https://splunk.cloud.cms.gov/en-US/app/cms_bbapi_landing_app/bb2_authorization_flow_dashboard from Django Admin BB2-TOOLS -> Splunk Dashboards which points to https://splunk.cloud.cms.gov/en-US/app/cms_bbapi_landing_app/bb2_authorization_flow_dashboard

TODO: login into django admin, go to BB2 Tools -> Splunk dashboard -> BB2 Authorization Flow Dashboard, click the link, it should take you to the splunk dashboard.

Spanish authorization flow generation facilitate:

A customized sample app at : https://github.com/CMSgov/bluebutton-sample-client-python-react/pull/69 Which is handy to generate auth events logging with Spanish language code, note since the built in TestApp is excluded from Splunk searches of the "BB2 Authorization Flow Dashboard", it is recommended to use the sample app to hit your own app.

If you're reviewing this PR, please check these things, in particular:

Test A:

Pick an ENV: prod, impl, test Pick a time range e.g. 06/01/2024 - 07/08/2024 with closing end date (before current date to avoid stats and counts varying) Check the numbers for correctness, especially the authorization requests count where Spanish medicare login used.

Test B: Create an app in the ENV, use a client e.g. BB2 sample app to hit the app and trigger a Spanish medicare login with lang=es as query parameter of the authorization URL.

Then check the "Spanish" stats from the dashboard e.g. using time range "past 60 minutes"...

What Security Implications Does This PR Have?

Submitters should complete the following questionnaire:

What Needs to Be Merged and Deployed Before this PR?

This PR cannot be either merged or deployed until the following pre-requisite changes have been fully deployed:

Any Migrations?

Submitter Checklist

I have gone through and verified that...:

jimmyfagan commented 3 months ago

Jim, the link in the description is giving me a 404 so it's hard to see the changes here. I would be okay with you just updating the main dashboard directly, if there's anything we're unhappy with, we can always revert to an earlier version of the xml file. Otherwise, I might just need screenshots or a quick huddle to complete this review. The changes do look good, just would like to verify what it looks like in Splunk

loganbertram commented 3 months ago

Yeah, I think we need to see the changes deployed to get an idea. This all looks ok, though.

JFU-NAVA-PBC commented 3 months ago

new dashboard promoted, also generated 5 spanish authorization flows using app = BB2-3276-APP

JFU-NAVA-PBC commented 3 months ago

Looks good to me. Tested both english and Spanish on Test and this makes sense to me. I think in the future we may try to purge the term 'beneficiary' from our UI but that is for a later date.

agree