If user does not declare read schema or preprocess step (which is always the case when ingesting data from a file upload) we apply the following new inference rules:
if event_time column is present - we will try to coerce it into a timestamp
strings will be parsed as RFC3339 date-times
integers will be treated as UNIX timestamps in seconds
if any of the columns conflicts with system column - it will get renamed with an underscore prefix
While I like being strict about names and types, I think this should improve the overall user experience.
Description
Closes: #790
If user does not declare
read
schema orpreprocess
step (which is always the case when ingesting data from a file upload) we apply the following new inference rules:event_time
column is present - we will try to coerce it into a timestampWhile I like being strict about names and types, I think this should improve the overall user experience.
Checklist before requesting a review