ietf-tools / relaton-data-ids

Bibliographic data information for Internet-Drafts in Relaton format
7 stars 10 forks source link

Crawler GHA is too slow #38

Closed kesara closed 2 months ago

kesara commented 1 year ago

To enable authors to cite the latest IDs submitted to datatracker, crawler GHA should run regularly. At least hourly.

Since the last update to the crawler GHA, this has become slower. The GHA sometimes take close to 3 hours to finish.

At the moment this GHA is set to run every 3 hours but due to slowness, some GHAs fail to complete before the start of the next action causing them to fail from time to time.

kesara commented 2 months ago

43 avoids failures by ensuring only a single instance of GHA runs at a time.