search

fkie-cad / nvd-json-data-feeds

Community reconstruction of the legacy JSON NVD Data Feeds. This project uses and redistributes data from the NVD API but is neither endorsed nor certified by the NVD.
114 stars 16 forks source link

Latest release 3 days old? #6

Closed P-T-I closed 11 months ago

P-T-I commented 11 months ago

In the readme you state that a daily release is foreseen; the current release is 3 days old, where can I find the release from today?

rhelmke commented 11 months ago

Hello, good catch! One of our monitoring scripts failed.

I'm investigating and will fix ASAP.

P-T-I commented 11 months ago

Cool! Thanks!

rhelmke commented 11 months ago

Sooo, the VM that creates the nightly releases ran out of memory when creating the cve-all feed .. Seems that the initial 8GB were a little bit optimistic for level 9 xz compression of the whole NVD.. and the raw dataset just grew over that memory limit during compression.

We allocated 64GB to the worker and added some workflows in #7 to establish external monitoring that notifies us once there hasn't been a release or sync in the past 24hrs.

Finally, I manually issued a release run to verify. New packages should be available now. The regular release timetable should be fixed now :-).

Cheers