More accurate progress bar for single table Quality Report - Githubissues

sdv-dev / SDMetrics

Metrics to evaluate quality and efficacy of synthetic datasets.

https://docs.sdv.dev/sdmetrics

MIT License

210 stars 45 forks source link

More accurate progress bar for single table Quality Report #361

Closed npatki closed 1 year ago

npatki commented 1 year ago

Problem Description

The current progress bar always increments in 4 steps (no matter how many columns I have) and doesn't give me much insight into the progress.

Expected behavior

Instead of a single progress bar, we can show 2 progress instead: One for the Column Shapes property and one for Column Pair Trends.

Column Shapes: Increment through each of the columns. A table with n columns will have a progress bar that increments n times.
Column Pair Trends: Increment through each unique pair of columns. A table with n columns will have a progress bar that increments n(n-1)/2 times.

Example

report.generate(real_data, synthetic_data, metadata, verbose=True)

Generating report ...
(1/2) Evaluating Column Shapes: 100%|██████████| 25/25 [00:00<00:00,  7.09it/s]
(2/2) Evaluating Column Pair Trends: 100%|██████████| 325/325 [00:00<00:00,  7.09it/s]

Overall Quality Score: 82.84%

Properties:
- Column Shapes: 82.78%
- Column Pair Trends: 82.9%