rocketlaunchr / dataframe-go

DataFrames for Go: For statistics, machine-learning, and data manipulation/exploration
Other
1.19k stars 95 forks source link

Can I read CSV file in batch? #34

Closed n-is closed 4 years ago

n-is commented 4 years ago

I would like to know if I can read a CSV file in batches. If it is possible, how can I do it? I looked through the docs and examples and could not find the required information. Any help would be appreciated.

Thank you.

pjebs commented 4 years ago

You will have to implement it yourself. You will need familiarity with the "encoding/csv" package.

You can find guidance here: https://github.com/rocketlaunchr/dataframe-go/blob/master/imports/csv.go#L70

It is actually not that difficult to do.