tenzir / public-roadmap

The public roadmap of Tenzir
https://docs.tenzir.com/roadmap
4 stars 0 forks source link

Input Format Detection #6

Open mavam opened 2 years ago

mavam commented 2 years ago

The ultimate form of data onboarding is not having to specify the format, but letting VAST do it automagically. For example, instead of writing from stdin read json it should be possible to simply write from stdin without having to specify json, csv, or any other format.

We could realize this with an auto format that's a "meta format" that sequentially tries all formats in row until it can confidently parse one.

This requires #5.

### Definition of Done
- [ ] #5
- [ ] We agreed on a design for input format detection.
- [ ] We implemented the designed approach.
mavam commented 11 months ago

We spoke with a user today who wants this feature.