Adds secret handling for poctools publishing. make publish will now automatically publish to PyPi. (Remember to gopass sync)
Employs a new folder structure to handle aggregations and datasets. The folder structure is documented in /docs/poc_pipeline_flow.png, but looks something like /data/{dataservice,dataset}/{10_raw,20_aggregations,30_result}/
Adds an aggregator which based on a visibility.json, name.json, specificationURL.json and description.json enriches the apis harvested in /data/dataservice/10_raw and exports the result to /data/dataservice/30_result/{protected,public}.json
This PR:
make publish
will now automatically publish to PyPi. (Remember togopass sync
)