Closed rebekkabry closed 8 months ago
We're building a high-level dashboard that synthesizes real-time data to visualize the work and goals of TPW and its divisions.
Phase 1: Current State
[] gather ATD data sources [] gather PW data sources [] link to organization divisions, departments and/or programs TPW [] investigate missing areas or gaps
Phase 2: Gap Investigation
[] TDB
[] compiled list of TPW data sources [] diagram that shows all our applications and how data flows between them and the open data portal [] automated updates for https://atd.knack.com/dts#open-data-inventory/
results.resource.name; results.resource.description; results.resource.type; results.resource.publication_date; results.classification.domain_category; results.classification.domain_metadata.value (frequency to update); results.permalink; results.link;
Outcome Additional Values:
[] find trends, relational concepts, commonality and story value [] list of assets for TPW? Possible github type record and note sharing?
[] build standardized reporting or data sets needs across business function areas [] insight into overlaps and/or gaps [] insight into executive main interests and/or gaps
Considering a survey to send out to all division managers inquiring about data and reporting current details. To include items such as:
Get feedback from Amenity on best approach and /or additional questions to include in survery
Current Compiling Views:
7/6/23 - Meeting with Amenity to review MVP.
Questions to Answer:
Notes:
Status Notes: Map of applications/products to Data Sources
Organization Function > Division > Output (in progress)
DTS | Data and Technology Services Portal Knack review and model build out - in progress.
Applications Insights - based on the current "applications form"...
Fields / Filters to Consider
What doesn’t make it to list show up on test or prototype list
For OPSDB or 3rd DB; filter Application Class: Enterprise, Database - Other, Database Server, Web Application - Other, Device-Specific Firmware/Software, Enterprise Business System For OPSDB Local Fles; filter Application Class: Computer File For Knack Application Tool OPSDB; filter Application Class: Knack Application For OutputAccess; Filter Application Class: ArcGIS Online Web App, ArcGIS Online Feature Service For OutputAccess: note ArcGIS Online Feature Service has layers URL, how to include, metadata export available?
- Note some databases may need to be added manually for instance Hanson - SBO
Results/Impact
Roles: Operations Tools (3rd party, DTS Supported, CW), ETL in, Storage, Storage Access/Dataset Details, ETL out, Output, Output Access
current Knack connections
proposed Knack connections
Current Support of TPW Departments and Programs
Divisions | Role |
---|---|
Finance | |
Human Resources | |
Data & Technology Services | |
Performance Management | |
Parking Enterprise | |
Public Info PM | |
Administrative Manager | |
Legal Affairs | |
Street and Bridge Operations | Service |
District Maintenance | Service |
Utilities & Structures | Service |
Pavement Operations | Service |
Urban Forestry | Service |
Transportation Engineering | Service |
Capital Services/ Project Delivery | Service |
Active Transportation Engineering Services | Service |
Vision Zero - Transportation | Service |
Signs and Markings | Service |
Arterial Management "Signals" | Service |
Office of Special Events | Service |
Right of Way (ROW) Management | Service |
Office of the City Engineer | Service |
Sidewalks and Special Projects | Service |
Community Services | Service |
Emergency Management | Service |
Logistics | Service |
Capital Program Consultant Strategic Projects | |
Public Info & Mktng PM Strategic Com & Outreach | |
Smart Mobility/ TDM | |
Long Range Planning | |
Transportation Development Services | |
Capital Program Conslt. Program & Project Development | |
City Wide |
Divisions | Power BI | PW Power BI | Knack | ArcGIS | TPW Stat | SD23/Pwstat | |
---|---|---|---|---|---|---|---|
Total Count Supported | 6 | 16 | 17 | ||||
Total Count Supported % | 19% | 50% | 53% | ||||
Department Count (all) | 32 | ||||||
Service Departments (only) Count | 18 | ||||||
Service Count Supported | 5 | 7 | 14 | ||||
Service Count Supported % | 28% | 39% | 78% |
Moving this out of "Ongoing" to "In Progress" since it is a project.
Summary Report 1/11 with DTS Management:
Ecosystem Map is an enterprise-wide view of the data sources that support our business dashboards and provide insight into operational performance.
Background
Prior to the TPW merger, PW and ATD respectively have developed a variety of datasets, data source locations, operational tools and dashboards that provide insight into business activities and consideration for business initiatives toward changes. Currently there is no standard data documentation or visibility into the data pipelines that support our major dashboards and tools. The ideal behind the Ecosystem map is to provide documentation to support current tools, provide standardized data mapping documentation standards, and to provide stakeholders with a centralized “themed” platform to access all dashboards, reports, resources related to a specific workgroup or tools.
This map and documentation will be the backbone for current and upcoming projects. Such as: Dash, TPWStat, 311 integrations, etc.
Scope & Deliverables
Due to the large, complex nature of this initiative, we are planning to address this initiative in 4 phases:
Phase 1 – Collecting Start to End
Phase 2 – Current State Mapping Dashboard/Tools Level
[ ] Transpose maps into single line
Phase 3 - High Level Data Relationships between the stakeholders
[ ] Enterprise Wide Excel Mapping
[ ] Enterprise Wide Data Connections
Phase 4 – Centralized Platform Build Out
Desired Outcomes
Timebox
This is an iterative project that will accumulate data from different divisions as data owners become available to walk through the pipeline and variations of data collected.
Concepts and references
What is a data ecosystem map?
A data ecosystem map illustrates the different actors in a data ecosystem, and how value is exchanged across it. A data ecosystem consists of data infrastructure, and the people, communities and organizations that benefit from the value created by it. Data infrastructure is made up of data assets, standards, technologies, policies and the organizations that steward and contribute to them.
Why use the tool of an ecosystem map? Creating a data ecosystem map helps to understand how data creates value. It identifies the data, data stewards and data users; the different roles they play; and the relationships between them. You can use your map as a practical tool to plan and visualize a data ecosystem, or show opportunities for increasing value to particular parts of a data ecosystem. A data ecosystem map can be used to:
Opportunities and Value
Request details
https://atd-dts.gitbook.io/wiki/product-ops/dts-website#images The first image will be used as the project's thumbnail image on the website.
This Github issue represents a project of Austin Transportation's Data & Technology Services team. Project status is documented regularly in the comments below.