Nike-Inc / brickflow

Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
https://engineering.nike.com/brickflow/
Apache License 2.0
183 stars 36 forks source link

fix ignore permission error due to most likely being caused by shared clusters #97

Closed stikkireddy closed 6 months ago

stikkireddy commented 6 months ago

This resolves the permissions issues in brickflow on shared clusters.

Description

This

Related Issue

Resolves issue #31 and #96

How Has This Been Tested?

Unit test has been included

Screenshots (if appropriate):

Checklist:

codecov[bot] commented 6 months ago

Codecov Report

Attention: 1 lines in your changes are missing coverage. Please review.

Comparison is base (548b6cb) 90.27% compared to head (9e5a103) 90.32%.

Files Patch % Lines
brickflow/engine/task.py 92.30% 1 Missing :warning:
Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #97 +/- ## ========================================== + Coverage 90.27% 90.32% +0.05% ========================================== Files 22 22 Lines 3361 3381 +20 ========================================== + Hits 3034 3054 +20 Misses 327 327 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.