LibertyDSNP / parquetjs

Fully asynchronous, pure JavaScript implementation of the Parquet file format with additional features
MIT License
55 stars 25 forks source link

Error processing parquet file: invalid compression method: ZSTD #150

Closed vedantroy closed 3 weeks ago

vedantroy commented 4 weeks ago

Thanks for reporting an issue!

Steps to reproduce

When I try to open a valid parquet file (pandas can open it):

        console.log('opening')
        const reader = await parquet.ParquetReader.openFile(values["input-file"]);
        console.log('reading')
        const cursor = reader.getCursor();
        console.log('cursor')

        let record = null;
        let count = 0;
        console.log('looping')
        while ((record = await cursor.next())) {
            console.log(record);
            count++;
        }

I get the error:

Error processing parquet file: invalid compression method: ZSTD

Package version: 1.8.5

I will try to give a sample parquet file to aid in debugging.

wilwade commented 3 weeks ago

@vedantroy Currently we do not have support for zstd compression. Open to PRs for it.

Duplicate of https://github.com/LibertyDSNP/parquetjs/issues/77