Framework does not allow to read files encoded in UTF-16 LE

microsoft / data-factory-testing-framework

A stand-alone test framework that allows to write unit tests for Data Factory pipelines on Microsoft Fabric, Azure Data Factory and Azure Synapse Analytics.

MIT License

88 stars 20 forks source link

Framework does not allow to read files encoded in UTF-16 LE #80

Closed LeonardHd closed 8 months ago

LeonardHd commented 8 months ago

Fabric's git integration stores pipeline-content.json currently as UTF-16-LE. The testing framework fails to read these fails as: https://github.com/microsoft/data-factory-testing-framework/blob/b228f1db59c07c24287cd3d2666cd30b16da3904/src/data_factory_testing_framework/_repositories/_factories/fabric_repository_factory.py#L18

opens file with r and thus tries to utf-8 encode.