How to perform filter operations on a CSV/Parquet file

intel / qpl

Intel® Query Processing Library (Intel® QPL)

https://intel.github.io/qpl/

MIT License

96 stars 19 forks source link

How to perform filter operations on a CSV/Parquet file #36

Closed Johnnyjax closed 1 month ago

Johnnyjax commented 5 months ago

Hello, I can't seem to find an example that reads from a CSV file to perform a filter operation like scan or extract. Does QPL support this? I know IAA works with in-memory databases, so does one have to convert to some format first supported by IAA?

Thanks.

mzhukova commented 4 months ago

Hi @Johnnyjax , QPL doesn't support reading specific input formats, but rather reading a raw output, you'll need some sort of a wrapper function to parse CSV or any other format and input this into QPL. You can check out our current examples for scan to see how to use QPL APIs at https://github.com/intel/qpl/blob/develop/examples/low-level-api/scan_for_specific_value_example.cpp.

mzhukova commented 1 month ago

Closing as no reply in a long time, please feel free to re-open if still relevant.