tenzir / public-roadmap

The public roadmap of Tenzir
https://docs.tenzir.com/roadmap
4 stars 0 forks source link

URI Connector #57

Closed mavam closed 7 months ago

mavam commented 1 year ago

Unlike other connectors, the URI connector is "meta connector" that enables a new syntax to access a combination of connector and format. The initial implementation should use the familiar URL syntax:

from https://example.com/path/to/file.json | ...

Without the URI connector, users would have to write:

from https example.com/path/to/file.json read json | ...

This is much less ergonomic, doesn't allow for copy-and-paste of dataset URLs, etc.

### Definition of Done
- [x] Agree on the operator syntax.
- [x] Design how this interacts with (or supersedes) default formats for connectors.
- [x] Implement `from <URI>`.
- [x] Implement `to <URI>`.
- [x] Support implicit compression and decompression
- [x] Map file extensions onto parsers and printers