aboutcode-org / scancode-toolkit

:mag: ScanCode detects licenses, copyrights, dependencies by "scanning code" ... to discover and inventory open source and third-party packages used in your code. Sponsored by NLnet project https://nlnet.nl/project/vulnerabilitydatabase, the Google Summer of Code, Azure credits, nexB and others generous sponsors!
https://aboutcode.org/scancode/
2.13k stars 551 forks source link

Support SQLite as an output format #808

Open jdaguil opened 7 years ago

jdaguil commented 7 years ago

It would be great if ScanCode supported SQLite file format as an output.

mjherzog commented 7 years ago

Specifically we should have a post-scan plugin to create an AboutCode SQLite file ready for AboutCode Manager. Converting a JSON file to SQLite as the first step in using AboutCode Manager is not a great first impression and this conversion is effectively a background process in any case.

vivonk commented 6 years ago

@mjherzog @jdaguil is this work still incomplete? I would like to work on this 😄

steven-esser commented 6 years ago

@vivonk This is still incomplete and you are free to work on it.

If you are interested, I can go into more detail on the general schema required for SQLite output file.

mjherzog commented 5 years ago

We need this output to streamline codebase analysis especially with "rightsizing" multiple Scans for a codebase so that the Scan files are easier to use in Workbench.

adityaviki commented 3 years ago

@majurg Can you provide the schema for the SQLite output file.

steven-esser commented 3 years ago

@adityaviki For now, you can refer to schema found in: https://github.com/nexB/scancode-workbench/

Two ways to view the schema:

  1. Trace the various Sequelize ORM code in scancode-workbench to get a list of all the tables + fields
  2. load up an example scan using scancode-workbench, and then you can view the resulting .sqlite file for a more granular schema listing