google / osv.dev

Open source vulnerability DB and triage service.
https://osv.dev
Apache License 2.0
1.49k stars 186 forks source link

fix(nvd-mirror): increase deadline to 2h #2538

Closed andrewpollock closed 1 month ago

andrewpollock commented 1 month ago

Given the cron job runs every 2 hours, there's nothing gained by arbitrarily terminating it before that. At 260K records over 130 pages, the best case scenario for retrieval alone is ~780 seconds (and growing) and with intermittent failures and retries, could exceed an hour.

And that's before the time taken to split by year.