[Fix] Add overwrite functionality to the BoxFileWriterClass - Githubissues

Nike-Inc / koheesio

Python framework for building efficient data pipelines. It promotes modularity and collaboration, enabling the creation of complex pipelines from simple, reusable components.

https://engineering.nike.com/koheesio/

Apache License 2.0

602 stars 29 forks source link

[Fix] Add overwrite functionality to the BoxFileWriterClass #103

Closed ToneVDB closed 4 days ago

ToneVDB commented 1 week ago

Description

Add an overwrite flag to the BoxFileWriter class

Related Issue

Parially solves #89

Motivation and Context

When writing to box and the file already exists, you want to be able to overwrite the existing file with a new version

How Has This Been Tested?

This has been tested on databricks and box - when a file exists and doesn't, the writer does the right thing

Screenshots (if appropriate):

Types of changes

[x] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

[x] My code follows the code style of this project.
[x] My change requires a change to the documentation.
[x] I have updated the documentation accordingly.
[x] I have read the CONTRIBUTING document.
[ ] I have added tests to cover my changes.
[x] All new and existing tests passed.