2023_jul_epic #story_h: Align OMHSP SME competencies for GS-13 Data Scientist Position

[ghost]

Story K Health Equity: Need: Establishing new data pipelines and dashboards in alignment with PERC guidance and resources. *Need: Establishing new data pipelines and dashboards in alignment with PERC guidance and resources. Who else could help with this? Possibly James' new hire Data Science Lifecycle: 50%**

• [ ] Identifies, adapts, and manages changes to data analysis tools in response to evolving user needs.
• [ ] The incumbent requires expertise in and management of end-to-end data processes in the data life cycle. Mastery experience with data science tools to execute duties is required; these duties including programming, statistics, machine learning, causal inference, and data visualization.
• [ ] Constructs data pipelines using complex tools and techniques to handle data at scale. Data Science Consultant and Advisor - 25%
• [ ] Ensures that data sources are fit for their intended purpose through assessment of potential bias in data ingestion and transmission mechanisms, current data quality, monitoring for incoming changes in data quality, and improvement of data quality.

Story K and Story A: Need: Analysis of current and future grant aims who else could help with this? David N, does he have any weaknesses in the types of analysis he would want support on? Machine learning? Data Science Lifecycle: 50%

• [ ] Has experience with prediction and causal inference methods.
• [ ] Uses appropriate analytic and statistical software to programmatically prepare data for analysis and clean imperfect data such as probabilistic matching and imputation of missing values.
• [ ] Articulates findings through data visualization, reports, and operationalized constructs.
• [ ] Demonstrates expert level understanding of diverse data science techniques including data pooling, machine learning, natural language processing, deep learning, advanced visualizations and has the ability to demonstrate how ensembles of these techniques can be harmonized into user-centric solutions.

Story B Need: Bug squashing, automation (i.e. Publishing Power BI updates), and updating data pipelines (SQL) who else could help with this? Me, but I currently do not have a lot of time to spend on these and inflow is greater than outflow, I don't expect inflow to reduce in the futured Data Science Consultant and Advisor - 25%

• [ ] Provides technical advice serving as a SME in the development of new methods to automate reports, rapid analysis of pilot initiatives and applications and makes recommendations to management on the use of such technology as it relates to Agency data.
• [ ] Accesses, merges, cleans, standardizes, and develops derived metrics on multiple structured datasets; has familiarity with appropriate software and automation tools. Also serves as a resource to junior analysts and contractor staff, as directed by supervisor. Project Leadership Related to Data Analytics and Technical Liaison - 25%
• [ ] Designs, develops, and operates systems for ingesting, storing, and analyzing data at scale.
• [ ] Uses data parallelization techniques or streaming technologies to process data. Monitors data flows and stored datasets to make improvements to data collection and ingestion mechanisms.

[ghost]

Competencies I pulled based on the requirements I highlighted in my comment above.

---

1. • 676 - Health Informatics - Knowledge of health informatics, i.e. design, configuration and management of health information and clinical support systems; health data collection, storage, extraction, manipulation, reporting and communications.
2. • 657 - Health Information Exchange - Performs functions related to the electronic transmission of healthcare-related data among medical facilities, health information organizations and government agencies according to healthcare interoperability standards.
3. • 66- Database Management Systems - Knowledge of the uses of database management systems and software to control the organization, storage, retrieval, security, and integrity of data.
4. • 63 - Data Management - Knowledge of the principles, procedures, and tools of data management, such as modeling techniques, data backup, data recovery, data dictionaries, data warehousing, data mining, data disposal, and data standardization processes.
5. • 6006 - Health Information Technology Standards Development - Ability to understand the current technical Health Information Technology standards landscape, the desired future HIT technical standards landscape and a practical path between the two. Ability to collaboratively devise implementable technical solutions that are approved by consensus.
6. • 409 - Decision Support - Knowledge of decision support theories, methods, and tools for identifying, synthesizing, representing, and evaluating the important aspects of a decision situation and prescribing the recommended course for decision makers and other stakeholders.
7. • 497 - Systems Thinking - Performs analysis that focuses on the way that a system's constituent parts interrelate and how systems work over time and within the context of larger systems; considers the whole system and recognizes links between everything from the complex network of global to departmental priorities.
8. • 191 - Modeling and Simulation - Knowledge of the tools and techniques used to develop functional, physical, or prototype models and simulations for test and evaluation programs, the prediction of behavior and phenomena, and to visually communicate concepts.
9. • 190 - Modeling and Simulation - Knowledge of mathematical modeling and simulation tools and techniques to plan and conduct test and evaluation programs, characterize systems support decisions involving requirements, evaluate design alternatives, or support operational preparation.
10. • 244 - Reading - Understands and interprets written material, including technical material, rules, regulations, instructions, reports, charts, graphs, or tables; applies what is learned from written material to specific situations.
11. • 248 - Reasoning - Identifies rules, principles, or relationships that explain facts, data, or other information; analyzes information and makes correct inferences or draws accurate conclusions.
12. • 146 - Information Technology Research and Development - Knowledge of scientific principles, methods, and tools of basic and applied research used to conduct a systematic inquiry into a subject matter area.

[lzim]

Discussed at hq_workflow 02/09/2023 @epearman @lzim @emilymetcalf114

Current DataOps Pain Points to consider with our GS-13 Data Scientist Position

• [ ] Priority SQL support for @dkngenda based on @epearman's limited bandwidth.
• [ ] Power BI -> VA/CDW experience is critical; Health Informatics, Computer Scientist
• [ ] @dkngenda Are there any upcoming R01 or IIR analyses that you think we should recruit expertise to address?

[dkngenda]

@lzim Below are the main skills I can think of

Computational skills:

• Familiarity with R, particularly data manipulation with tidyverse and visualization with ggplot
• Advanced SQL skills

Statistics:

• Hierarchal Linear Modeling (or Growth curve modeling) given the nature of our study design,
• Basic understanding or interest in psychometric analyses

[hthrmarsh]

@lzim

Data Science/Stats/Health Informatics skills identified by @epearman and @dkngenda:

• C++
• API
• Government Cloud Computing support to automatic Data UI Updates
• Power BI --> VA CDW experience is critical
• Familiarity with R, particularly data manipulation with tidyverse and visualization with ggplot
• Advanced SQL skills
• Hierarchal Linear Modeling (or Growth curve modeling) given the nature of our study design,
• Basic understanding or interest in psychometric analyses

After reviewing the GS13T14 Data Scientist PD and the DataOps PAVIR PD, here is what I would pull out for competencies for the Job Analysis 0938A form (we cannot call out specific skills, i.e., C++ for example, in the competency list). We want to keep the number of competencies to about 5 or so and link them to specific tasks in the PD:

You could word the Selective Placement Factor as: The incumbent will have experience with data science, statistics, and health informatics to support the operations and development activities for a national quality improvement project within a healthcare organization. This is necessary in order to provide advice and subject-matter expertise in tasks, projects, and assignments related to developing, coordinating, and improving database to data science workflows for healthcare quality improvement and health system operational partners.

[hthrmarsh]

@lzim

The highlighted is what I would pull out for competencies (see above). You want between 4-6 competencies at the most since then you pull out specific tasks and duties from the GS-13 PD and link them and each competency should, ideally, have 2-4 duties linked to it from the PD. There's only one AI item in the GS-13 to link, but based on SAFe 6.0, it might be something core we want pulled out for hiring. Data Scientist GS-1560-13T14 PD 99489T 99490T.pdf

I highlighted the competencies in the attached - but please review when you can since any changes can be resubmitted. Data Scientist GS-13_Competency Library Markup 2023.03.20.xlsx Data Scientist GS-1560-13T14 PD 99489T 99490T.pdf

[ghost]

I have tracked the February efforts related to this card in #2920. This card will be tracking April efforts

[lzim]

@hthrmarsh

@lzim - Removing from wk2 due to cross-covering #people_ops_workstream See question on wk2 2023_may_epic team_time document - tracked on #2952

When is this likely to actually be due?

[hthrmarsh]

@lzim - I don't know. Randy doesn't know either since this consult process is new with the HRMACS transition and everything has been pretty much delayed by four months and nobody knows when HRMACS staff will dig out. I followed up with him today:

I rescoped it on the maps.

[lzim]

Discussed at wk1 2023_jun_epic

team_time

@lzim @dkngenda @hthrmarsh

• @lzim Update: VA Form 0938 - Job Analysis - SME
• Outline the OMHSP Data Science competencies drawn from the PERC/NEPEC GS-13 Data Science Position
• https://dvagov.sharepoint.com/sites/VHAPERC/Reports https://www.usajobs.gov/job/726164700 https://www.usajobs.gov/job/726044400

Align with - https://scaledagileframework.com/

• Communities of Practice
• Shared Services

Suppress the 17 AI competency within a broader core Data Science Science Competency

• Data Cleaning
• Data Wrangling/Transformation
• Data Visualization
• Building Data Models & Predictive Analytics

[hthrmarsh]

@lzim, you could list a competency and select SME as a drop down. HRMACS consultant, Jamie Moceri suggests that it's not usually done (few and far between), but could try. Can't say with any 100% certainty that the DEU won't have a problem with it.

[hthrmarsh]

Moved to June 27th.

[hthrmarsh]

Discussed Consultation Request: DEU Recruitment - ORD Station 640 VISN 21 with Jamie Moceri and Timothy Alonzo (6/27/23)

• [ ] @lzim review competencies
• [ ] Review Importance/Frequency list (HRMACS consultants suggest that it's unusual to see a lot of 5s)
• [ ] Specialized Experience statement - statement by which we measure applicants against
• Jamie Moceri and Tim Alonzo to draft and provide statement for Specialized Experience comment
• @lzim Experience with CDW and VA mental health care data but open to the public so shouldn't write it as VA-specific.
  • [x] Tim to prepare a post-consult email.
  • [x] Jamie & Tim will meet to draft these documents.
  • [ ] Finalize specialized experience.
  • [ ] Submit to MSS.
  • [ ] Post #1 - 3-Business - Canvas for Federal Priority hires.
  • [ ] Documentation to DEU send a job announcement to me.

MAJOR DUTIES: Data Cleaning & Visualization

[hthrmarsh]

Tim sent post-consult email 6/30/23

[lzim]

Done and sent 👍🏽