So I want to get stats on a big csv file, I firstly used the FSharp.Data.CsvProvider but then I realized that Deedle could be appropriate for the stuff I am doing. BUT this is what I've done :
Frame.ReadCsv("PathToMyOverThan1GBfile.csv")
This is what I got (I am running this on an Ubuntu Server with the last available mono version and my fsharpi is on 64 bits)
System.OutOfMemoryException: Out of memory
at <StartupCode$FSI_0002>.$FSI_0002.main@ () <0x417c20e0 + 0x001d3> in <filename unknown>:0
at (wrapper managed-to-native) System.Reflection.MonoMethod:InternalInvoke (System.Reflection.MonoMethod,object,object[],System.Exception&)
at System.Reflection.MonoMethod.Invoke (System.Object obj, BindingFlags invokeAttr, System.Reflection.Binder binder, System.Object[] parameters, System.Globalization.CultureInfo culture) <0x7fda9575a5d0 + 0x000a1> in <filename unknown>:0
Stopped due to error
So I want to get stats on a big csv file, I firstly used the FSharp.Data.CsvProvider but then I realized that Deedle could be appropriate for the stuff I am doing. BUT this is what I've done :
This is what I got (I am running this on an Ubuntu Server with the last available mono version and my fsharpi is on 64 bits)