PR110 added a select-all wildcard in ModifyColumnsOperation. By using "*" as the column name, you can apply the same column transformation to every column in the dataframe.
There are two additions I'd like to make to this feature:
Allow asterisks to be used as a wildcard capture for partial column name matching, not just all columns. This match could be done using the built-in fnmatch library. For example (thanks Tom):
PR110 added a select-all wildcard in
ModifyColumnsOperation
. By using"*"
as the column name, you can apply the same column transformation to every column in the dataframe.There are two additions I'd like to make to this feature:
Allow asterisks to be used as a wildcard capture for partial column name matching, not just all columns. This match could be done using the built-in fnmatch library. For example (thanks Tom):
Extend wildcard matching to more column operations:
ModifyColumnsOperation
DropColumnsOperation
KeepColumnsOperation
MapValuesOperation
DateFormatOperation
SnakeCaseColumnsOperation