Open kmhleonwillens opened 4 months ago
Thanks for reporting an issue!
Create a schema with the ParquetWriter utility and describe a primitive array field, and try to append a row with a matching input:
ParquetWriter
const testSchema = new ParquetSchema({ doesWork: ParquetWriter.createStringField(), doesNotWork: ParquetWriter.createListField('UTF8'), }); const writer = await ParquetWriter.openFile(testSchema, '/tmp.parquet'); await writer.appendRow({ doesWork: 'foo', doesNotwork: ['bar', 'baz'] }); await writer.close();
The writer should accept the row input as it seemingly matches the schema definition.
The row is not appended as the writer throws an error.
When catching the error, the output is:
too many values for field: doesNotWork
It works when defining the list field manually, as seen in the README file.
Thanks for reporting an issue!
Steps to reproduce
Create a schema with the
ParquetWriter
utility and describe a primitive array field, and try to append a row with a matching input:Expected behaviour
The writer should accept the row input as it seemingly matches the schema definition.
Actual behaviour
The row is not appended as the writer throws an error.
Any logs, error output, etc?
When catching the error, the output is:
Any other comments?
It works when defining the list field manually, as seen in the README file.