datafusion-contrib / bdt

Boring Data Tool
Apache License 2.0
198 stars 18 forks source link

add: automatically detect filetype without rely on ending #25

Open matthias-Q opened 3 months ago

matthias-Q commented 3 months ago

This PR uses the lib file-format to detect the filetype using the magic number. for Plaintext files like json/csv, we fall back to the file ending variant.

This addresses the issue #24