Datagovteam wants to update the Harvesting database with the results of the harvest job.
Acceptance Criteria
[ACs should be clearly demoable/verifiable whenever possible. Try specifying them using BDD.]
[ ] GIVEN a harvesting job has completed
THEN we should run the report (summary job) method
[ ] GIVEN a harvesting job has completed without errors
THEN the job in the harvest_job table, should be updated with "status: complete" and the summary job report information.
[ ] GIVEN a harvesting job has errored out
THEN an error should be logged in the harvest_job_error table
AND the harvest job should be updated with "status: error" (TBD)
AND a POST should be made to the job/complete route
[ ] GIVEN a harvesting job has completed
THEN a POST should be made to the job/complete route
Background
Note: we may not complete the AC to post to job/complete right away, as it depends on https://github.com/GSA/data.gov/issues/4760 being done, in which case it can be bundled into that ticket.
User Story
Datagovteam wants to update the Harvesting database with the results of the harvest job.
Acceptance Criteria
[ACs should be clearly demoable/verifiable whenever possible. Try specifying them using BDD.]
[ ] GIVEN a harvesting job has completed THEN we should run the report (summary job) method
[ ] GIVEN a harvesting job has completed without errors THEN the job in the harvest_job table, should be updated with "status: complete" and the summary job report information.
[ ] GIVEN a harvesting job has errored out THEN an error should be logged in the harvest_job_error table AND the harvest job should be updated with "status: error" (TBD) AND a POST should be made to the
job/complete
route[ ] GIVEN a harvesting job has completed THEN a POST should be made to the
job/complete
routeBackground
Note: we may not complete the AC to post to
job/complete
right away, as it depends on https://github.com/GSA/data.gov/issues/4760 being done, in which case it can be bundled into that ticket.Security Considerations (required)
[Any security concerns that might be implicated in the change. "None" is OK, just be explicit here!]
Sketch