search

Tecnarca / patectsdgym

A refactor and extension of the PATECTGAN model with an evaluation suite based on OpenDP
MIT License
4 stars 3 forks source link

Would you be interested in contributing a similar set of contributions to the DPSDGYM directly? #1

Open eedeleon opened 3 years ago

eedeleon commented 3 years ago

Hope you are doing well, these have been crazy times.

We noticed your changes to the repo as well as here and became excited to see interest in this space.

Currently DPSDGYM is hiding in the tests directory, but we were hoping to have someone promote it to a top level benchmarking directory, similar to what you have done here.

benchmarking/dpsdgym/...

We were also considering ways of moving our metrics to the opendp-whitenoise library

If you are interested in making any of these contributions let us know here or by filing an issue with a proposal for how the imports/evals would work.

Also, an upcoming rename may affect this repo. We will leave the opendp-whitenoise library on pypi for some time to avoid breaking users.

Looking forward to possibly collaborating more with you.

Tecnarca commented 3 years ago

Hi @eedeleon,

I would love to try and make this contribution. I am currently in a phase where I would like to expand DPSDGym to be a proper framework to provide an all-around evaluation of DP data generators: I have some ideas for developing some other metrics, but I would like to see wheter they prove to be useful or not before committing or proposing wrong pull requests to the repository.

Regardless, I'd love to ask you some questions on what would be best to develop and assess, just to have a small plan of what we would like to have. We can discuss this in the same meeting as the one that you asked in https://github.com/opendifferentialprivacy/smartnoise-sdk/pull/288

I've replied there with my general availability, let me know there how you would like to proceed.