DataCater allows users to filter and transform data using Python functions. Despite having access to entire records, they can change only one column at a time. Having the possibility to change entire rows at a time is useful for many use cases, one of them being the flattening of JSON objects.
Our current format for transforms is as follows:
def transform(row, value, config):
return value
We should keep the same format but allow to return entire rows, e.g.:
DataCater allows users to filter and transform data using Python functions. Despite having access to entire records, they can change only one column at a time. Having the possibility to change entire rows at a time is useful for many use cases, one of them being the flattening of JSON objects.
Our current format for transforms is as follows:
We should keep the same format but allow to return entire rows, e.g.: