search

microsoft / data-factory-testing-framework

A stand-alone test framework that allows to write unit tests for Data Factory pipelines on Microsoft Fabric and Azure Data Factory.
MIT License
68 stars 15 forks source link

Framework does not allow to read files encoded in UTF-16 LE #80

Closed LeonardHd closed 4 months ago

LeonardHd commented 4 months ago

Fabric's git integration stores pipeline-content.json currently as UTF-16-LE. The testing framework fails to read these fails as: https://github.com/microsoft/data-factory-testing-framework/blob/b228f1db59c07c24287cd3d2666cd30b16da3904/src/data_factory_testing_framework/_repositories/_factories/fabric_repository_factory.py#L18

opens file with r and thus tries to utf-8 encode.