A Data Publisher can have different data sets that are similar and belong to the same Data Owner. When publishing those data sets to the same LDES server using the same LDIO (or NiFi) workbench he/she needs to create multiple nearly identical pipelines which only differ in the source URL that is polled.
To ease maintenance of these pipelines and to keep the configuration simple and compact, it would be better if the LdioHttpInPoller component could handle one or more source URLs. Currently there is no need for a different polling interval if multiple URLs are specified.
The configuration would ideally allow specifying one URL as a string for backwards compatibility as well as an set of URLs as an array, i.e.:
A Data Publisher can have different data sets that are similar and belong to the same Data Owner. When publishing those data sets to the same LDES server using the same LDIO (or NiFi) workbench he/she needs to create multiple nearly identical pipelines which only differ in the source URL that is polled.
To ease maintenance of these pipelines and to keep the configuration simple and compact, it would be better if the LdioHttpInPoller component could handle one or more source URLs. Currently there is no need for a different polling interval if multiple URLs are specified.
The configuration would ideally allow specifying one URL as a string for backwards compatibility as well as an set of URLs as an array, i.e.:
and: