Knowledge-Graph-Hub / neat-ml

Network Embedding All the Things
BSD 3-Clause "New" or "Revised" License
18 stars 1 forks source link

output metrics after classifier training in JSON format #22

Closed justaddcoffee closed 3 years ago

justaddcoffee commented 3 years ago

Right now at the end of a NEAT run, metrics like AUROC, AUPRC, etc are printed to stdout during training.

These should be emitted as a JSON or some computable format.

justaddcoffee commented 3 years ago

One way to do this: each of the steps that output metrics (embeddings, classifiers, etc) outputs a file in output of the form embeddings_metrics.yaml, classifiers_metrics.yaml. The names of these files are specified in the YAML section in question

justaddcoffee commented 3 years ago

To start addressing this, I made this PR - this outputs metrics for graph embeddings. Need to do the same for classifier training, but shouldn't be too hard

justaddcoffee commented 3 years ago

addressed by #29