FenTechSolutions / CausalDiscoveryToolbox

Package for causal inference in graphs and in the pairwise settings. Tools for graph structure recovery and dependencies are included.
https://fentechsolutions.github.io/CausalDiscoveryToolbox/html/index.html
MIT License
1.08k stars 198 forks source link

All labels in TCEP are equal #51

Closed ArnoVel closed 4 years ago

ArnoVel commented 4 years ago

Hi, I was doing some more experiments using CGNN based algorithms on TCEP, and I couldn't replicate the results. I also got only 60% accuracy using the hyperparameters that got me 75%~ a few months ago. I couldn't find the cause of this, but when I printed the labels they were all 1. Is this a mistake?

Edit: I checked the commit warnings, apparently you did permute all pairs so that the labels is 1, and still is the right label. I'll compare with other instances of the dataset but I'm now reassured!