Nike-Inc spark-expectations issues

Nike-Inc / spark-expectations

A Python Library to support running data quality rules while the spark job is running⚡

https://engineering.nike.com/spark-expectations

Apache License 2.0

147 stars 32 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Adding the params config to the row expectations

#103 vigneshwarrvenkat opened 1 day ago
0
[FEATURE] Test Spark-Connect Compatibility

#102 newfront opened 6 days ago
0
[BUG] Results from row data quality checks not matching actual record counts

#101 PKJ-x7 opened 2 weeks ago
8
End to End solution for editing rules on a User Interface.

#100 cskcvarma opened 3 weeks ago
0
Rule changer

#99 cskcvarma closed 3 weeks ago
0
[FEATURE] Build a UI for feeding the Data Quality Rules.

#98 vigneshwarrvenkat opened 4 weeks ago
1
Implement Base Structure and GitHub OAuth Login

#97 cskcvarma closed 1 month ago
0
optimization and additional columns to detailed stats

#96 jskrajareddy21 closed 1 month ago
0
[FEATURE] Update documentation

#95 IMC07 closed 1 month ago
0
[FEATURE] Loosen pluggy version

#94 mikita-sakalouski closed 1 month ago
0
[FEATURE] Loosen pluggy version

#93 mikita-sakalouski closed 1 month ago
0
[BUG] Meta row dq_results section is empty in error table

#92 blaine12100 opened 1 month ago
0
A User Interface for non technical users to edit and submit rules via a git interface

#91 cskcvarma closed 1 month ago
0
Updating the flow diagram and enabling summarized row dq to capture all results (fail/pass) as part of PR - 80

#90 vigneshwarrvenkat closed 1 month ago
0
WIP - Integrate with github, render user card and a repos list. [DO NOT MERGE]

#89 cskcvarma closed 1 month ago
0
Bug fix on PR- 80

#88 vigneshwarrvenkat closed 2 months ago
0
[FEATURE] Enable Users to Customize Email Body Modification

#87 adityapansare opened 2 months ago
0
Adding range comparision functionality to aggdq Detailed Stats table

#86 nishantsingh93 closed 2 months ago
1
Drop TempView is not supported latest Databricks clusters and Naming conventions

#85 jskrajareddy21 closed 2 months ago
1
[BUG] Drop TempView is not supported latest Databricks clusters

#84 asingamaneni closed 2 months ago
0
Integrating the notifications to Zoom Webhook

#83 amaldevk88 closed 1 week ago
6
Enabling push notifications to Zoom webhook

#82 amaldevk88 closed 1 week ago
0
[FEATURE] Add a range expression to Aggregation data quality expectation

#81 vigneshwarrvenkat closed 2 months ago
0
Creating a detailed stats table for capturing details on the execution of dq rules.

#80 vigneshwarrvenkat closed 3 months ago
1
code update for dynamic rules

#79 jskrajareddy21 closed 3 months ago
1
[BUG] Adding {env} tag to the target table, skips the rules to be processed

#78 vigneshwarrvenkat closed 1 month ago
1
[FEATURE] Enable Data Profiling using Spark Expectations

#77 asingamaneni opened 3 months ago
0
Parameterized Rules

#76 jskrajareddy21 closed 3 months ago
1
Introduce an option for quarantine data

#75 jskrajareddy21 closed 3 months ago
0
enable flag for error table

#74 jskrajareddy21 closed 3 months ago
1
update row dq summary

#73 jskrajareddy21 closed 4 months ago
1
[FEATURE] Remove usage of RDD's as Databricks cluster with shared mode doesn't allow it

#72 asingamaneni closed 3 months ago
0
Update writer.py

#70 jskrajareddy21 closed 4 months ago
2
improving failed recording writing process and enabling details stats table

#69 jskrajareddy21 closed 4 months ago
1
[FEATURE] Performance improvement

#68 pinnapuvijay closed 1 month ago
0
Apply spell checks

#67 SamyCoenen closed 4 months ago
2
rewrote generate_summarised_row_dq_res

#66 IMC07 closed 5 months ago
2
[BUG] meta_dq_run_date should be called meta_dq_run_datetime in error table

#65 IMC07 closed 4 months ago
1
[FEATURE] Return meta_dq_run_id after executing the expectations

#64 IMC07 closed 1 month ago
1
[BUG] The input_count is less than the output_count in the stats table

#63 DevathiNNikhil opened 6 months ago
1
[BUG] The overall error count doesn't match with detail counts in "row_dq_res_summary" in the stats table

#62 IMC07 closed 3 months ago
2
[Feature] updating code to work for retries if the save table fails

#61 asingamaneni closed 6 months ago
3
[FEATURE] Enable concurrent writes to stats table

#60 asingamaneni closed 6 months ago
0
Update CONTRIBUTORS.md - for PR #57

#59 BharatKumarEY closed 7 months ago
1
Add teams notification feature

#58 BharatKumarEY closed 7 months ago
1
Add teams notification feature - Enabling push notifications to teams channel

#57 BharatKumarEY closed 7 months ago
4
Enabling push notifications to teams channel

#56 BharatKumarEY closed 7 months ago
0
[FEATURE] Enhance QueryDQ feature to capture the source and target values

#55 vigneshwarrvenkat closed 1 month ago
1
[BUG] It's not possible to pass authentication for the email notifications

#54 bilsbernd opened 7 months ago
0
[FEATURE] Add all test executions in stats table

#53 jonaslieben closed 3 months ago
0