Closed BiggyBing closed 1 year ago
Hi @BiggyBing, I'm not sure if you are still having problems with this, as it's been some time since the issue was filed.
Since this issue was filed, we have significantly updated the usage/API and streamlined the SDGym library's functionality. The benchmarking scripts will now report several metrics such as modeling time, memory usage and synthetic data quality.
For more resources see the new SDGym documentation.
Unfortunately, the benchmarking script cannot be used as-is for to reproduce the experiment in the CTGAN paper -- as this experiment has a more advanced setup with an ML integration and holdout group. If you are still looking to reproduce the CTGAN results, I'd recommend asking the question in the SDV library.
Description
I am going to reproduce all results reported in the CTGAN paper. However, I cannot fully reproduce the reported results:
What I Did
For reproducing, I follow the demo: