search

aboutcode-org / vulnerablecode

A free and open vulnerabilities database and the packages they impact. And the tools to aggregate and correlate these vulnerabilities. Sponsored by NLnet https://nlnet.nl/project/vulnerabilitydatabase/ for https://www.aboutcode.org/ Chat at https://gitter.im/aboutcode-org/vulnerablecode Docs at https://vulnerablecode.readthedocs.org/
https://public.vulnerablecode.io
Apache License 2.0
535 stars 201 forks source link

Improve export command #1571

Closed pombredanne closed 1 month ago

pombredanne commented 2 months ago

This PR improves the "export" command for FederatedCode

  1. the export now uses less memory and does not load the whole DB at once
  2. we no longer export DB ids
  3. the output schema is simplified
  4. there is a new "aboutcode.hashid" package that is meant to be reused in FederatedCode

This is ready for review. I will likely use Serializers in the future

This also fixes https://github.com/aboutcode-org/vulnerablecode/issues/1579

pombredanne commented 1 month ago

@keshav-space do you mind to look into this? this is needed for FederatedCode

pombredanne commented 1 month ago

The docs build is failing on URL validation. I am merging anyway.