Created RuleMap class which contain following below method,
fill_rule_map_object_by_catalog
apply_ruleset_on_schema
apply_ruleset_on_stream_name
apply_rules_to_original_field
apply_ruleset_on_api_response
Added extra method add_child_into_metadata to add nested fields into metadata.
The catalog contains the original-name field in metadata which contains the actual name field and the breadcrumb contains the standard name of the field.
During sync mode, apply_ruleset_on_api_response would be called which converts the original field value to standard name, and then the transform would be applied.
Description of change
Created
RuleMapclass which contain following below method,fill_rule_map_object_by_catalogapply_ruleset_on_schemaapply_ruleset_on_stream_nameapply_rules_to_original_fieldapply_ruleset_on_api_responseAdded extra method
add_child_into_metadatato add nested fields into metadata.The catalog contains the
original-namefield in metadata which contains the actual name field and the breadcrumb contains the standard name of the field.During sync mode,
apply_ruleset_on_api_responsewould be called which converts the original field value to standard name, and then the transform would be applied.Manual QA steps
Risks
Rollback steps