netsiphd / netrd

A library for network {reconstruction, distances, dynamics}
https://netrd.readthedocs.io/en/latest/
MIT License
166 stars 43 forks source link

Validating reconstructors against reference implementations #254

Open sdmccabe opened 5 years ago

sdmccabe commented 5 years ago

Same as #245 but for the reconstructors. My suspicion is that most of these don't have easily comparable reference implementations, so those can be checked off fairly quickly. The implementers of each method probably did some checks for reference implementations so we should reach out to them.

leotrs commented 5 years ago

It'd be nice (if at all possible) to have a single script/notebook to run once we have identified reference implementations.

sdmccabe commented 5 years ago

I was thinking about something similar; the challenge of course is that not all the reference implementations are in Python. I guess for R-based implementations we can still use Jupyter, but what about Matlab or C++? Another possibility would be another repository containing the validation scripts.

leotrs commented 5 years ago

Uuuuuuh let's not do another repo...