pulibrary / lib_jobs

Enterprise Services batch processing tasks. Rails 7 Ruby 3.1.0
4 stars 0 forks source link

[Submit collection] Create a cron job to move the 25 oldest files from `new-updates` to `backlog` #763

Closed christinach closed 5 months ago

christinach commented 5 months ago

Description

@mzelesky has been manually moving daily the 25 oldest files in lib-sftp-prod from the alma/recap/new-updates to alma/recap/backlog.

What needs to change

Create a cron job that runs daily and moves the 25 oldest files from alma/recap/new-updates into the alma/recap/backlog. Do not count or move the .._delete.tar.gz files.

Level of urgency

Why is this maintenance needed?

@mzelesky should not be doing this manually

Acceptance criteria

Notes

@carolyncole thank you for the practical suggestion! Online resources for a similar script

This was discussed and decided in the Orangelight meeting on April 18th, 2024

carolyncole commented 5 months ago

For Monday I might consider ignoring the delete file constraint to make it simpler...

maxkadel commented 5 months ago

Since it's an sftp connection, I think going the pure bash route might be more difficult.

kevinreiss commented 5 months ago

Closing in favor of #765.