Copy Faros API cfg from destination cfg to source cfg.
This is only done when the source is farosai/airbyte-faros-feeds-source and the destination is the Faros destination.
In this case, users of the CLI can omit Faros API config arguments from the source args.
While working on this, I upgraded my jq from 1.6 to 1.7 and found out that split behaves differently and this broke the writeConfig function. In writeConfig, we create a long string of the key/value pairs of config items passed via the CLI args, separated by a special separator. We then have a jq expression to split by the separator and merge all the key/value pairs to create the json config. This logic assumes that the number of elements after split is an even number. But sadly this is no longer true in version 1.7:
To make this work in 1.7, we just trim the last occurrence of the separator.
Description
Copy Faros API cfg from destination cfg to source cfg. This is only done when the source is
farosai/airbyte-faros-feeds-source
and the destination is the Faros destination. In this case, users of the CLI can omit Faros API config arguments from the source args.While working on this, I upgraded my
jq
from 1.6 to 1.7 and found out thatsplit
behaves differently and this broke thewriteConfig
function. InwriteConfig
, we create a long string of the key/value pairs of config items passed via the CLI args, separated by a special separator. We then have ajq
expression to split by the separator and merge all the key/value pairs to create the json config. This logic assumes that the number of elements aftersplit
is an even number. But sadly this is no longer true in version 1.7:To make this work in 1.7, we just trim the last occurrence of the separator.
Type of change
Related issues
Migration notes
Extra info