I started using my reader.NewParquetReader to read 2.5GB parquet file. After several attempts, I am getting below error.
I used SkipRows to read pages instead of loading the entire file into memory. I already set gogc=[4000, 6000, even 10000] but no luck.
fatal error: out of memory allocating heap arena metadata
I started using my reader.NewParquetReader to read 2.5GB parquet file. After several attempts, I am getting below error. I used SkipRows to read pages instead of loading the entire file into memory. I already set gogc=[4000, 6000, even 10000] but no luck.
fatal error: out of memory allocating heap arena metadata
I require some help Thank you.