search

datafusion-contrib / bdt

Boring Data Tool
Apache License 2.0
210 stars 20 forks source link

Specify Filetype #24

Open matthias-Q opened 8 months ago

matthias-Q commented 8 months ago

Hi, I noticed that some widely used tool product parquet files with no ending (e.g. trino/athena when using UNLOAD) Would be nice if this cool could accept a parameter that specifies the filetype instead of guessing it from the ending.

matthias-Q commented 8 months ago

I am preparing a PR for this issue using https://github.com/mmalecot/file-format. This should allow us to detect the filetype of at least Avro and Parquet files.