pola-rs / nodejs-polars

nodejs front-end of polars
https://pola-rs.github.io/nodejs-polars/
MIT License
437 stars 44 forks source link

Add support for `allowMissingColumns` flag in nodejs-polars client #284

Open mostopalove opened 1 month ago

mostopalove commented 1 month ago

Description: I would like to request the addition of support for the allowMissingColumns flag in the Node.js client, similar to its current implementation in the Python client.

This feature is documented in the Python API here: Polars Python Documentation - allow_missing_columns

In the Node.js client, the current available options for ScanParquetOptions can be found here: Node.js Polars Documentation - ScanParquetOptions

Feature Request: Please consider adding the allowMissingColumns flag to the Node.js client's ScanParquetOptions to provide consistency across different client implementations.

In addition, this feature should help resolve errors like "Error: schemas contained differing number of columns", which arise when loading parquet files with schema inconsistencies between different files.

Thank you for considering this request!

Bidek56 commented 1 month ago

allow_missing_columns was just added to to Polars, we need to let it bake a bit and be added to a RS release first. :)

liadhorovitz commented 1 month ago

Thanks @Bidek56 Any estimation for the "baking" time? :)

universalmind303 commented 1 month ago

the rust release cadence is a bit slower than Python. Historically, it looks like there's a release every 1-2 months