datafusion-contrib / bdt

Boring Data Tool
Apache License 2.0
210 stars 20 forks source link

add: automatically detect filetype without rely on ending #25

Open matthias-Q opened 8 months ago

matthias-Q commented 8 months ago

This PR uses the lib file-format to detect the filetype using the magic number. for Plaintext files like json/csv, we fall back to the file ending variant.

This addresses the issue #24