[10k]: Analytics - Incremental export of GitHub data

[widal001]

Definition

Set up a process/system for incrementally exporting data from GitHub instead of exporting the full set of project and issue data.

Business Goals

Problem: As the number of issues in our repository grows, we'll approach a point where it's no longer feasible to export all of issue and project from our repo. Additionally, the current strategy of exporting all data misses an opportunity to compare historical changes to issue status.

Value: Setting up a process for storing historical data and switching to incremental exports allows us to increase the long-term sustainability of exporting our issue and project data.

Objectives

• {1 sentence description of goal for this deliverable}
• {1 sentence description of goal for this deliverable}

In scope

• Setting up a light-weight data warehouse for issue data
• Switching to a incremental ETL pattern for exporting data

Out of scope

• Creating new metrics that take advantage of historical data for comparisons

Tasks

• [ ] {Link to tasks that should be completed with this deliverable}

Definition of Done

• [ ] {Condition that must be satisfied by this deliverable}

[widal001]

Replacing our old 10k ft deliverable issues with a new Epic format

[widal001]

Reopening for review during sprint planning