Open gab23r opened 1 year ago
Scan needs to recieve a path, whereas zipfile
requires supplying Polars with a file handle to the internal file location, because your zip could contain more than one file. Even on files you can get an unambiguous path towards, though, like czv.gz and csv.xz, scan_csv
will actually refuse to read those and ask you to use read_csv
instead (see https://github.com/pola-rs/polars/issues/7287).
read_csv
can read singlular compressed files just fine. But when globbing, scan_csv
gets called, causing it to give up.
Not sure why this doesn't work in the current implementation.
Problem description
I wish I could use polars to scan zipped csv (and more ?) files.
This exemple works with
read_csv
but fails withscan_csv