xitongsys / parquet-go

pure golang library for reading/writing parquet file
Apache License 2.0
1.27k stars 293 forks source link

Produce parquet and upload to Impala cause WARNINGS #455

Open wjp287 opened 2 years ago

wjp287 commented 2 years ago

when i use the code to produce parquet file and upload to Impala cause WARNINGS:

select * from event_test limit 1; Query data appears: WARNINGS: File 'hdfs://nameservice01/test/event_test/17730/0/part.parquet' column 'event_id' contains decimal data but the table metadata has type INT (1 of 113 similar);

my code: type Student struct { EventId int32 parquet:"name=event_id, type=INT32" }

use parquet-tools look schema part.parquet: message parquet_go_root { required int32 event_id = 0; } Why is it here = 0;