aboutcode-org / scancode.io

ScanCode.io is a server to script and automate software composition analysis pipelines with ScanPipe pipelines. This project is sponsored by NLnet project https://nlnet.nl/project/vulnerabilitydatabase/ Google Summer of Code, nexB and others generous sponsors!
https://scancodeio.readthedocs.io
Apache License 2.0
115 stars 85 forks source link

Refactor pipeline to extract reusable basepipeline in module and library #1332

Closed tdruez closed 2 months ago

tdruez commented 3 months ago

This PR refactors the pipelines architecture to extract a reusable BasePipeline in its own module and also available as standalone library

This is going to support adopting pipelines in VulnerableCode and PurlDB

Reference:

tdruez commented 2 months ago

The code in this branch is currently experimental and not ready for merge/production.

tdruez commented 2 months ago

This PR is already too complex combining the module refactoring, the Pipeline classes refactoring, packaging logic, and new CI for release publishing.

Let's split this into manageable and simpler-to-review parts: