LibertyDSNP / parquetjs

Fully asynchronous, pure JavaScript implementation of the Parquet file format with additional features
MIT License
43 stars 24 forks source link

Feature: Frequency Schema Builder #86

Closed wilwade closed 1 year ago

wilwade commented 1 year ago

Problem

Adds a Frequency Schema Builder to support easy building of parquet files from https://github.com/LibertyDSNP/schemas/

Closes: #73

In general expands the data that can easily build a Parquet file.

Change summary:

Steps to Verify:

  1. Grab a Parquet schema from https://github.com/LibertyDSNP/schemas/
  2. const [parquetSchema, writerOptions] = ParquetSchema.fromFrequencySchema(frequencySchema);
  3. Now you have the schema as well as the writer options to use. See the test for a full example.
wilwade commented 1 year ago

Closing in favor of https://github.com/LibertyDSNP/schemas/pull/33