microsoft / dotnet

This repo is the official home of .NET on GitHub. It's a great starting point to find many .NET OSS projects from Microsoft and the community, including many that are part of the .NET Foundation.
https://devblogs.microsoft.com/dotnet/
MIT License
14.43k stars 2.21k forks source link

Issue related to .net version 4.8 in Isolated mode. Getting SetCapacity, Out of Memory error while saving parquet file to Azure ADLS #1424

Open Birundhaa-dev opened 10 months ago

Birundhaa-dev commented 10 months ago

Tag Name xxx - at System.IO.MemoryStream.set_Capacity(Int32 value) at System.IO.MemoryStream.EnsureCapacity(Int32 value) at System.IO.MemoryStream.Write(Byte[] buffer, Int32 offset, Int32 count) at Parquet.File.Streams.SnappyInMemoryStream.Write(Byte[] buffer, Int32 offset, Int32 count) at Parquet.File.Streams.GapStream.Write(Byte[] buffer, Int32 offset, Int32 count) at System.IO.BinaryWriter.Write(Byte[] buffer) at Parquet.Data.Concrete.StringDataTypeHandler.WriteOne(BinaryWriter writer, String value) at Parquet.Data.BasicDataTypeHandler1.Write(SchemaElement tse, BinaryWriter writer, IList values, Statistics statistics) at Parquet.File.DataColumnWriter.WriteColumn(DataColumn column, SchemaElement tse, IDataTypeHandler dataTypeHandler, Int32 maxRepetitionLevel, Int32 maxDefinitionLevel, Statistics statistics) at Parquet.File.DataColumnWriter.Write(List1 path, DataColumn column, IDataTypeHandler dataTypeHandler) at Parquet.ParquetRowGroupWriter.WriteColumn(DataColumn column)

Need help on the above issue if someone has faced the same