I am glad the latest datapm CLI support object type. This is a fairly easy enhancement in the Timeplus sink. If the column is in object type, we will create the column as json type and send the the raw json in the HTTP request.
For example, the postgres table is aircraft_data, the model column is a JSONB
A stream will be created in Timeplus, with json type (internally we call this as object('json'), which is subject to change)
Then you can query them with columnName.jsonPath, such as model.en
I am glad the latest datapm CLI support object type. This is a fairly easy enhancement in the Timeplus sink. If the column is in
objecttype, we will create the column asjsontype and send the the raw json in the HTTP request.For example, the postgres table is aircraft_data, the
modelcolumn is a JSONBA stream will be created in Timeplus, with
jsontype (internally we call this as object('json'), which is subject to change)Then you can query them with columnName.jsonPath, such as
model.en