Azure / Azure-DataFactory

Other
485 stars 590 forks source link

Copy activity: JSON array #687

Open alleycat58uk opened 3 months ago

alleycat58uk commented 3 months ago

When using the rest connector on the sink side of a copy activity, JSON arrays are not supported. MS docs state "The array of object as the response body is not supported in pagination."

The support for pagination in this senario is really powerful and negates the need to use an until activity iteration with pipeline variables.

Given the prevalence of rest calls returning multiple JSON objects within an array, and the fact that a JSON array is a 'standard' object in itself, can the copy activity add support for this rather than hardcoding the first object in the array? in the mapping