search

GSA-TTS / FAC

GSA's Federal Audit Clearinghouse
Other
18 stars 5 forks source link

Epic: Historic Data Migration #2837

Closed sambodeme closed 5 months ago

sambodeme commented 8 months ago

Description

This epic focuses on developing a structured model for logging changes in historic data and executing the initial migration of this data. The goal is to establish a model for tracking modifications made to historic data during the migration process and to identify potential improvement areas of the current migration code without altering the data.

Tasks

- [ ] https://github.com/GSA-TTS/FAC/issues/2840
- [ ] https://github.com/GSA-TTS/FAC/issues/2838
- [ ] https://github.com/GSA-TTS/FAC/issues/2841
- [ ] https://github.com/GSA-TTS/FAC/issues/2843
- [ ] https://github.com/GSA-TTS/FAC/issues/2842
- [ ] https://github.com/GSA-TTS/FAC/issues/2854
- [ ] https://github.com/GSA-TTS/FAC/issues/2874
- [ ] https://github.com/GSA-TTS/FAC/issues/2879
- [ ] https://github.com/GSA-TTS/FAC/issues/2895
- [ ] https://github.com/GSA-TTS/FAC/issues/2896
- [ ] https://github.com/GSA-TTS/FAC/issues/2909
- [ ] https://github.com/GSA-TTS/FAC/issues/2911
- [ ] https://github.com/GSA-TTS/FAC/issues/2912
- [ ] https://github.com/GSA-TTS/FAC/issues/2920
- [ ] https://github.com/GSA-TTS/FAC/issues/2894
- [ ] https://github.com/GSA-TTS/FAC/issues/2798
- [ ] https://github.com/GSA-TTS/FAC/issues/2582
- [ ] https://github.com/GSA-TTS/FAC/issues/2581
- [ ] https://github.com/GSA-TTS/FAC/issues/2580
- [ ] https://github.com/GSA-TTS/FAC/issues/2945
- [ ] https://github.com/GSA-TTS/FAC/issues/2949
- [ ] https://github.com/GSA-TTS/FAC/issues/2950
- [ ] https://github.com/GSA-TTS/FAC/issues/2671
- [ ] https://github.com/GSA-TTS/FAC/issues/2832
- [ ] https://github.com/GSA-TTS/FAC/issues/2988
- [ ] https://github.com/GSA-TTS/FAC/issues/2989
- [ ] https://github.com/GSA-TTS/FAC/issues/3066
- [x] Replace All Print Statements with Log
- [x] Remove/clean old comments
- [ ] https://github.com/GSA-TTS/FAC/issues/2993
- [ ] https://github.com/GSA-TTS/FAC/issues/3023
- [ ] https://github.com/GSA-TTS/FAC/issues/3030
- [ ] https://github.com/GSA-TTS/FAC/issues/3033
- [ ] https://github.com/GSA-TTS/FAC/issues/3060
- [ ] https://github.com/GSA-TTS/FAC/issues/3094
- [ ] https://github.com/GSA-TTS/FAC/issues/3134
- [ ] https://github.com/GSA-TTS/FAC/issues/3163
- [ ] https://github.com/GSA-TTS/FAC/issues/3166
- [ ] https://github.com/GSA-TTS/FAC/issues/3178
- [ ] https://github.com/GSA-TTS/FAC/issues/3202
- [ ] https://github.com/GSA-TTS/FAC/issues/3206
- [ ] https://github.com/GSA-TTS/FAC/issues/3215
- [ ] https://github.com/GSA-TTS/FAC/issues/3219
- [ ] https://github.com/GSA-TTS/FAC/issues/3220
- [ ] https://github.com/GSA-TTS/FAC/issues/3232
- [ ] https://github.com/GSA-TTS/FAC/issues/3289
- [ ] https://github.com/GSA-TTS/FAC/issues/3287
- [ ] https://github.com/GSA-TTS/FAC/issues/3385
benjaminrobinson commented 5 months ago

Hello! Do you have an estimated time of completion for the migration of the Historic Data from the Census?

My team loves the API as it is a huge improvement over using manual data uploads from the Census for our work! Thanks so much for developing this in the public so we can understand what is going on with the FAC project. I deeply appreciate it!

Sincerely, Ben Robinson. Manager of Data Strategy and Insights Universal Service Administrative Co. Email: ben.robinson@usac.org

jadudm commented 5 months ago

We don't generally communicate timelines here; we're deep in trying to finish this right now. We're doing final testing through our various staging environments before we commit things to production.

We'll post to

https://www.fac.gov/info/updates/

in conjunction with that completion.

Thank you for the interest and enthusiasm!

benjaminrobinson commented 5 months ago

Thanks, @jadudm! Appreciate the quick reply. Will look to the Updates page for more information going forward, there just hasn't been anything posted there since mid-December.

Sincerely, Ben Robinson. Manager of Data Strategy and Insights Universal Service Administrative Co. Email: ben.robinson@usac.org

jadudm commented 5 months ago

We've... been buried in the final details of the migration. We should have done an interim update. We'll get back on a good cadence.

jadudm commented 5 months ago

Closing this ticket. The individual sub-tickets can be picked up in backlog or other epics. We have moved the historic data to production, and now have more work to do around it. Congrats to the data migration subteam!

sambodeme commented 5 months ago

Link to next https://github.com/GSA-TTS/FAC/issues/3364