This branch is to add metadata awareness to singer-python's transform functionality. That way, it will be able to detect unselected or unsupported fields and drop them from the data without the tap having to do anything other than pass in the metadata dictionary that it already has.
Additionally, this adds the filtered fields that are dropped in this way to the logs to provide a mechanism for log analysis, much like the removed fields that currently exist.
This branch is to add metadata awareness to singer-python's transform functionality. That way, it will be able to detect unselected or unsupported fields and drop them from the data without the tap having to do anything other than pass in the metadata dictionary that it already has.
Additionally, this adds the filtered fields that are dropped in this way to the logs to provide a mechanism for log analysis, much like the removed fields that currently exist.