VirtualFlyBrain / vfb-pipeline-collectdata

Apache License 2.0
0 stars 0 forks source link

Built in labels should be split out to config: #18

Open dosumis opened 3 years ago

dosumis commented 3 years ago

Various unused built-in Neo:labels are showing up in versions of the VFB pipeline running non-VFB data:

Site, pub, DataSet, License. These are all labels used in the VFB KB. They should be controlled by some configuration file associated with dumping data from the KB.

CC @matentzn - could you point to where these are currently specified?

dosumis commented 3 years ago

Update: It's possible that these may just be coming from the VFB Grass file that seems to be bundled into prod. To test - look for these in the triplestore.

hkir-dev commented 3 years ago

probably coming from this file: https://github.com/VirtualFlyBrain/vfb-pipeline-update-prod/blob/master/pdb_set_indices.neo4j moving it to config project

dosumis commented 3 years ago

Being able to configure indexes is pretty critical to running a pipeline, so good to see this split out.