search

manojkarthick / pqrs

Command line tool for inspecting Parquet files
Apache License 2.0
296 stars 29 forks source link

Support for parquet directories #14

Closed Hoeze closed 3 years ago

Hoeze commented 3 years ago

Hi, I just tried your tool and I find it super useful :+1: However, I noticed that one cannot simply cat whole directories:

# pqrs cat vcf.parquet 
Error: ParquetError(General("underlying IO error: Is a directory (os error 21)"))

However, this works: pqrs cat vcf.parquet/**/*.parquet

It would be a nice convenience function if pqrs could handle this case.

manojkarthick commented 3 years ago

Thanks @Hoeze! I've added support for cat-ing parquet files recursively in directories with the latest release. Let me know if you face any issues.