cityofaustin / atd-data-tech

Austin Transportation Data & Technology Services
17 stars 2 forks source link

New Batch Job to Correct DS Expiration Date Issues #16894

Open TracyLinder opened 2 months ago

TracyLinder commented 2 months ago

Refer to #11824

Scenarios:

  1. Folder has not been issued, but an expiration date exists This is the one happening most frequently.
  2. Status is Expired, but expiration date is in the future (2020-026668 DS)
  3. Status is Active, but expiration date is in the past.
TracyLinder commented 2 months ago

1. Folder has not been issued, but an expiration date exists This is the one happening most frequently.

2. Status is Expired, but expiration date is in the future (2020-026668 DS) (Priya found 33 records on prod)

3. Status is Active, but expiration date is in the past. (39 records in PROD)

@Lpriya-LIT will add her query export to this issue.

TracyLinder commented 2 months ago

Next Steps

Lpriya-LIT commented 2 months ago

16894 - Scenario 3 - 39 records on prod.xlsx

Lpriya-LIT commented 2 months ago

16894 - Scenario 2 - 33 records on Prod.xlsx

rajeshlaunch commented 2 months ago

Notes:

  1. Explained all 3 scenarios to Kyle and provided information about each scenario.
  2. For Scenario 2 and 3, Raj will share the files to Kyle to review and possibly identify the pattern.
  3. Scenario 1 will be a batch process which is to remove expiration dates and Kyle in agreement with this.
  4. Next steps: Kyle will review the spreadsheet data and then will provide guidance to take necessary actions on those records as well as future records.

CC: @vschandramouli

rajeshlaunch commented 2 months ago

Notes from the meeting with Kyle and Kim:

2. Status is Expired, but expiration date is in the future (2020-026668 DS) (Priya found 33 records on prod)

One of the job is updating the expiration date even the folder is expired and the expiration date setup properly. Need to figure out, why?

3. Status is Active, but expiration date is in the past. (39 records in PROD)

On May 6th one of the batch updated all these "Active" records to "Expired". We need to figure it out with developer?

SubhaShroff commented 2 months ago

@rajeshlaunch @vschandramouli

Status is Active, but expiration date is in the past:

Here is the explanation why all the DS at once got expired: - JobRSN -38 (Expire BMEP Pemits whose expiry data has passed). This is the already existing batch on PROD that expires DS along with BP, MP, EP, PP permits if the permit has past expiry date and not EXPIRED, on daily basis. If you notice in the attached excel, since 25th February, 2024, this batch started giving error and may not be updating the permits' status due to failure. Looks like DSD fixed it or something has changed the batch got revived and started updating the permits since May 7th. This must be the reason that all 39 records must have reactivated at once on 7th. I checked the expiry date for all those DS , almost all has expiry date after on or after 25th Feb. Thank you. 38 - Batch Instances - Expire BMEP Pemits whose expiry data has passed.csv

TracyLinder commented 3 weeks ago

Conversation w/ ROW about scenario 2

TracyLinder commented 3 weeks ago

@rajeshlaunch can you please do research for the 2 triggering events described by Kim?