OpenMined / PyStatDP

Statistical Counterexample Detector for Differentially Private Mechanisms
MIT License
8 stars 3 forks source link

Power test/strength of validation #2

Open PatrickHunter opened 4 years ago

PatrickHunter commented 4 years ago

What?

The exact statistical power/level of validation provided by various settings for generating queries.

How long?

A few hours to a few days depending on if its in the paper on reread or needs to be derived from scratch.

Is your research related to a problem?

We need to know what settings to use as the default and to provide use friendly customization information in the documentation.

Additional Context

The previous validator was a bit clearer about this so it might be worth looking at its code or paper if the StatDP paper doesn't make it clear.

Harkirat155 commented 3 years ago

Regarding this issue, can you please elaborate.,

It's about time we begin working on the documentation part. 🚀