kamu-data / kamu-cli

Next-generation decentralized data lakehouse and a multi-party stream processing network
https://kamu.dev
Other
300 stars 13 forks source link

Auto rename and coerce columns on ingest #791

Closed sergiimk closed 1 month ago

sergiimk commented 1 month ago

Description

Closes: #790

If user does not declare read schema or preprocess step (which is always the case when ingesting data from a file upload) we apply the following new inference rules:

While I like being strict about names and types, I think this should improve the overall user experience.

Checklist before requesting a review

zaychenko-sergei commented 1 month ago

Changelog missing