support files with unicode BOM

databrickslabs / blueprint

Baseline for Databricks Labs projects written in Python

https://pypi.org/project/databricks-labs-blueprint/

Other

19 stars 8 forks source link

support files with unicode BOM #138

Closed ericvergnaud closed 2 months ago

ericvergnaud commented 2 months ago

Files uploaded using BinaryIO can start with a unicode BOM. When dowloaded, these files must be decoded by detecting the BOM. This does not apply to notebooks, because Databricks transforms the uploaded code before storage (pre-pending a header) and ignores the BOM if any (possibly a Databricks bug). As a result, it is not possible to store notebooks with a BOM.

github-actions[bot] commented 2 months ago

✅ 36/36 passed, 2 skipped, 1m32s total

_{Running from acceptance #205}