search

microsoft / data-factory-testing-framework

A stand-alone test framework that allows to write unit tests for Data Factory pipelines on Microsoft Fabric, Azure Data Factory and Azure Synapse Analytics.
MIT License
88 stars 20 forks source link

Evaluate function activity() in string attribute #112

Closed pol-defont-reaulx closed 3 months ago

pol-defont-reaulx commented 4 months ago

Hey,

I checked for it but didn't find anything in the code to handle it.

In a Copy Activity in a Data Factory pipeline, I add a WHERE condition in the typeProperties.source.sqlReaderQuery to filter using a date I got in a previous activity. The function I'm using looks like: @{string(activity('GetIncrementalFilterDate').output.firstRow.min_date)}

It would be good to be able to access to a result argument like the other expressions

arjendev commented 4 months ago

Hi @pol-defont-reaulx,

Sorry for my late reply, I was on holiday!

If the sqlReaderQuery is an expression, then the framework should automatically parse it as such and become available as a DataFactoryElement.

The following should be available: activity.type_properties["source"]["sqlReaderQuery"].result.

Feel free to share your pipeline definition here so that I can fully understand your context, thanks!

pol-defont-reaulx commented 3 months ago

Hi @arjendev,

My problem was that sqlReaderQuery was not marked as an expression and was a direct equal. Changing that made it works :)

Sorry for bothering you on this