aboutcode-org / purldb

Tools to create and expose a database of purls (Package URLs). This project is sponsored by NLnet project https://nlnet.nl/project/vulnerabilitydatabase/ and nexB for https://www.aboutcode.org/ Chat is at https://gitter.im/aboutcode-org/discuss
https://purldb.readthedocs.io/
35 stars 23 forks source link

Reorganize purldb repo #439

Open JonoYang opened 5 months ago

JonoYang commented 5 months ago

We have a lot of related code in different places. For example, the minecode/visitor and minecode/mapper modules have code that is logically together, but is currently separated. Reorganizing the repo helps with clarity and focuses the specific workflow we want.

We should organize code to reflect the multi-level data collection we want to do:

  1. Collect name, version, checksum
  2. Collect metadata from registry
  3. Collect package and scan

See also:

JonoYang commented 3 months ago

A start would be to merge the visitor and mapper files of each repo type and then place that in a new module called miners

JonoYang commented 2 months ago

The minecode visitors and mapper modules have been combined into the miners module.