search

leomarquine / php-etl

Extract, Transform and Load data using PHP.
MIT License
178 stars 81 forks source link

Feature Request: Unique Transformer #6

Closed lolaslade closed 5 years ago

lolaslade commented 6 years ago

A common issue that can come up is non-distinct values. My use case is an XML document where I am getting two columns as attributes. These can appear in the attributes more than once. This causes additional table updates during the load cycle.

leomarquine commented 5 years ago

You can remove duplicate rows now using the Unique Rows Transformer.