Nike-Inc / spark-expectations

A Python Library to support running data quality rules while the spark job is running⚡
https://engineering.nike.com/spark-expectations
Apache License 2.0
148 stars 32 forks source link

End to End solution for editing rules on a User Interface. #100

Open cskcvarma opened 3 weeks ago

cskcvarma commented 3 weeks ago

Description

This pull request provides an end-to-end solution for editing rules on a user interface. The implemented functionalities include:

  1. Rendering user GitHub repositories.
  2. Collecting YAML files from each repository.
  3. Rendering the contents of YAML files.
  4. Updating a rule.
  5. Saving and committing the changes to GitHub.

Related Issue

This pull request does not relate to existing issues, it is an enhancement.

Motivation and Context

The changes are necessary to provide a seamless way for users to edit rules within a user interface, thus improving user experience and efficiency in managing YAML file contents and rules.

How Has This Been Tested?

The changes have been tested by:

  1. Rendering multiple user GitHub repositories.
  2. Successfully collecting and rendering YAML files from these repositories.
  3. Updating rules in the YAML files.
  4. Committing changes to GitHub repositories.
  5. Testing was conducted in a local development environment with multiple test repositories to ensure functionality and reliability. Screenshots (if appropriate): ezgif-5-b34ec009f3

Types of changes

Checklist: