search

fedspendingtransparency / usaspending-api

Server application to serve U.S. federal spending data via a RESTful API
https://www.usaspending.gov
Creative Commons Zero v1.0 Universal
310 stars 113 forks source link

[DEV-11217] Adds spark job to archive data #4188

Closed collinwr closed 2 months ago

collinwr commented 2 months ago

Description: Creates new command archive_table_in_delta.py

This was tested in QAT

Requirements for PR merge:

  1. N/A Unit & integration tests updated
  2. N/A API documentation updated
  3. [ ] Necessary PR reviewers:
    • [ ] Backend
    • [ ] Operations
  4. [x] Matview impact assessment completed
  5. [x] Frontend impact assessment completed
  6. [x] Data validation completed
  7. N/A Appropriate Operations ticket(s) created
  8. [x] Jira Ticket DEV-11217:
    • [x] Link to this Pull-Request
    • [ ] Performance evaluation of affected (API | Script | Download)
    • [ ] Before / After data comparison

Area for explaining above N/A when needed: