Research: Review quartz scheduling jobs

[alangmaid]

• Inventory the current jobs in CAMPD/ECMPS 2.0, including environment they are operating.
• Identify overnight jobs in ECMPS 1.0. Do all of the overnight jobs that need to continue to run have equivalent Quartz jobs?
• Identify new jobs for development

[maxdiebold-erg]

Inventory of Current CAMPD/ECMPS 2.0 Jobs

In reviewing the current jobs in CAMPD/ECMPS 2.0, I found that section 4.7 of the runbook is almost up to date. The linked pull request (Feature/6063 update scheduler jobs) adds a few jobs that are currently missing.

The jobs are described in the runbook, but I will list them here for convenience:

Bulk File Jobs

• BulkDataFile
• AllowanceComplianceBulkDataFiles
• AllowanceHoldingsBulkDataFiles
• AllowanceTransactionsBulkDataFiles
• ApportionedEmissionsBulkData
• EmissionsComplianceBulkDataFiles
• FacilityAttributesBulkDataFiles
• BulkDataFileMaintenance

Check Engine Wrapper Job

• CheckEngineEvaluation

Queue Jobs

• BulkFileJobQueue
• EvaluationJobQueue
• SubmissionJobQueue
• EmailQueue
• SubmissionReminderProcessQueue
• SubmissionWindowProcessQueue

Job Listeners

• CheckEngineEvaluationListener

[djw4erg]

ECMPS 1.0 Overnight Jobs Needed in ECMPS 2.0.

• ECMPS Email Job
  • Runs the ECMPS 1.- Emission Submission Window logic that opens initial windows and produces notification and reminder emails.
  • In ECMPS 2.0, handled by the following Quartz jobs:
  • SubmissionReminderProcessQueue
  • SubmissionWindowProcessQueue
• Stage Agent Jobs
  • Loads submitted ECMPS XML into the ECMPS 1.0 Host.
  • In ECMPS 2.0, handled by the SubmissionJobQueue Quartz job.

ECMPS 1.0 Overnight Jobs Not Needed in ECMPS 2.0

• ECMPS Submission Monitor Job
  • Sends an email containing submission sets that have been waiting to queue too long or have been in the queue too long.
  • Only produces the emails when ECMPS is online and the number of Stage Agent jobs is zero.
  • Runs hourly.
• Gather Statistics Job
  • Gathers statistics for the CAMDECMPS schema using auto determined sample size.
  • Runs weekly.
• Job Status Notification Job
  • Sends an email containing the status of ECMPS and non-ECMPS jobs.
  • Runs daily.
• Re-Generate XML Files Job
  • Produces MP, QA and EM XML files that are loaded on the ECMPS 1.0 FTP site.
  • Runs daily.

[djw4erg]

Closing Comment

No new jobs are needed in the Quartz scheduler, so I am closing this ticket.