search

google / osv.dev

Open source vulnerability DB and triage service.
https://osv.dev
Apache License 2.0
1.54k stars 188 forks source link

feat: skip exporting data into subdirectories #2707

Closed hogo6002 closed 1 month ago

hogo6002 commented 1 month ago

Linux distributions have a large number of releases and products. Exporting each release into a subdirectory wastes a lot of memory and reduces exporter performance. Skipping the exporting of these subdirectories and keeping one directory for each ecosystem will improve exporter performance.

This PR will be merged after the weekly release, and performance will be tested on the test instance. If all looks good, an announcement email will be sent before moving this into production.

hogo6002 commented 1 month ago

LGTM, can you also update the documentation of our exports?

I will test the performance on a test instance first and update it in a follow-up PR after verifying the results.