Nike-Inc / brickflow

Pythonic Programming Framework to orchestrate jobs in Databricks Workflow

https://engineering.nike.com/brickflow/

Apache License 2.0

183 stars 36 forks source link

[FEATURE] Sanitise input of the `brickflow_internal_only_run_tasks` parameter #108

Closed maxim-mityutko closed 4 months ago

maxim-mityutko commented 4 months ago

Description

Clean user input to brickflow_internal_only_run_tasks parameter:

trim whitespaces
allow valid JSON list as input

Related Issue

105

Motivation and Context

Usability improvement

How Has This Been Tested?

Unit tests

Screenshots (if appropriate):

Types of changes

[ ] Bug fix (non-breaking change which fixes an issue)
[x] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

[x] My code follows the code style of this project.
[ ] My change requires a change to the documentation.
[ ] I have updated the documentation accordingly.
[x] I have read the CONTRIBUTING document.
[x] I have added tests to cover my changes.
[x] All new and existing tests passed.