search

eclipse / streamsheets

An open-source tool for processing stream data using a spreadsheet-like interface.
https://docs.cedalo.com/
Eclipse Public License 2.0
452 stars 53 forks source link

Update the arrivalTime with the `createdAt` time. #72

Closed floitsch closed 2 years ago

floitsch commented 2 years ago

Overwrites the arrival time of the meta information with the "createdAt" time.

floitsch commented 2 years ago

Given that the Toit server can buffer messages and isn't guaranteed to maintain order, it feels like using the "createdAt" time for the "arrivalTime" makes some sense.

Alternatively, I could add this information as additional meta field.

TENHOUBEN commented 2 years ago

Hi, I doubt that this would work, because the arrivalTime property is set within a machine too (when a message is added to the inbox). So I propose you better go with your suggested alternative, i.e. simply add an additional meta-field.

floitsch commented 2 years ago

Hi, I doubt that this would work, because the arrivalTime property is set within a machine too (when a message is added to the inbox). So I propose you better go with your suggested alternative, i.e. simply add an additional meta-field.

I think I tested it, and was able to override the value. But not 100% sure.

Will go with an extra meta-field. (createdAt).

TENHOUBEN commented 2 years ago

Ok, I've checked a bit closer and you are right :-) Same fields of a received message overwrite those added by machine. So both alternatives should do...

floitsch commented 2 years ago

One question: should I still go with the Excel serial time format? It seems like it's the preferred format in streamsheets.

TENHOUBEN commented 2 years ago

Yes, serial-number is the preferred time format within streamsheets, because it makes time based calculation easier. However, since you use a custom property you are free to choose. But if you plan to use this property for calculation using a serial-number is probably better.