When reading data from a kafka topic (using avro schema, without a schema registry), we cannot set the source event_time_field.
We need to create a job that would parse the input data (source defined via UI) and will allow us to define the sink timestamp.
Let's consider a source providing those fields:
select businesstime, asset, price
from source
We would want to define the sink kafka message timestamp as equal to businesstime.
When reading data from a kafka topic (using avro schema, without a schema registry), we cannot set the source event_time_field. We need to create a job that would parse the input data (source defined via UI) and will allow us to define the sink timestamp.
Let's consider a source providing those fields:
We would want to define the sink kafka message timestamp as equal to
businesstime.