ccao-data / data-architecture

Codebase for CCAO data infrastructure construction and management
https://ccao-data.github.io/data-architecture/
5 stars 3 forks source link

Create reporting "source-of-truth" design doc #458

Closed dfsnow closed 4 weeks ago

dfsnow commented 1 month ago

The Data Department gets asked to fill many ad-hoc reporting requests for various aggregate stats, usually partitioned by geography. This has resulted in a buildup of ad-hoc reporting views and tables over time. These ad-hoc views are difficult to debug and trust, because each of them is complicated in a slightly different way.

Rather than continue to create such ad-hoc views, we should consolidate our reporting efforts into a few larger views that cover the majority of CCAO reporting use cases. These new views will cover different groupings, geographies, and valuation stages, and will use a consistent methodology across time. They will serve as the new "source-of-truth" for both internal and external CCAO reporting.

This issue covers the scoping and design docs process for this effort.