Define Forestry Data Fix - Pattern 1 (Jenkins)

bcgov / nr_fsa_fingerprint

This repo is not for a specific project, but as a holder for the Forest Service Applications work by FSA team 2 (fingerprint)

Apache License 2.0

1 stars 0 forks source link

Define Forestry Data Fix - Pattern 1 (Jenkins) #57

Closed franTarkenton closed 1 year ago

franTarkenton commented 2 years ago

implement a simple datafix for Anne Marie using the on prem. Jenkins cron service.

First attempt of this task Consists of:

Getting the scripts that Anne Marie runs
Putting scripts into a github / or other repo (includes parameterize / extraction of any data that might be private (db link names as an example)
Create a jenkinsfile that will run the scripts

long term think about running this work in Openshift as a cron job and pipe the results / logs to the observability stack

amee99073 commented 2 years ago

We need the queries to determine if bad data exists, and the scripts to run to correct the data. The first attempt will be a very simply find records where value = Y and date < sydate-1day. For all records returned, set the Y to N The rest are a little bit more complex but there's another one that could be simple - run query x - if any rows are returned - send an email to predetermined person.