[PGA] consolidate multitool and borges-indexer into pga-create

src-d / datasets

source{d} datasets ("big code") for source code analysis and machine learning on source code

Other

322 stars 82 forks source link

[PGA] consolidate multitool and borges-indexer into pga-create #78

Closed smola closed 6 years ago

smola commented 6 years ago

Create a new pga-create tool that consolidates multitool, borges-indexer and set-forks. This is the single entry point (other than borges) to generate PGA.
Removed get-index and get-dataset subcommands, since we already have the pga cli for that purpose.

This is the first of a series of maintenance PRs to simplify the process of generating the PGA dataset.

smola commented 6 years ago

Given the monstrous amount of files changed in this PR because of vendor directory change, I suggest going to the commit list and review independent commits, except the vendor directory update one.

smola commented 6 years ago

@campoy Most of this code was just reuse from previous version. I'll add a PR addressing your review.