search

GoogleCloudPlatform / professional-services-data-validator

Utility to compare data between homogeneous or heterogeneous environments to ensure source and target tables match
Apache License 2.0
404 stars 117 forks source link

Feature request to suppress output header when no validations to report #1274

Open nj1973 opened 1 month ago

nj1973 commented 1 month ago

A request from a customer:

"Currently the schema validation outputs blank entries for tables matching (with --filter-status=fail). Is it possible to suppress the table outputs in such cases?"

This would apply to all validation types. The customer is redirecting results to CSV and not storing them in BigQuery.

I've raised this on their behalf but we would need to think carefully about how this might effect other users or general usability.

nj1973 commented 1 month ago

Related to this, another inconvenience around CSV headers is if we validate multiple tables in the same command and redirect the output to a CSV file then we get the header multiple times, part way through the file.

Ideally we would output the CSV header for the first run id and not for subsequent run ids.