search

go-gota / gota

Gota: DataFrames and data wrangling in Go (Golang)
Other
2.98k stars 277 forks source link

Golang + Dataframes + Arrow #68

Closed cjnolet closed 4 years ago

cjnolet commented 6 years ago

I stumbled upon your repo while searching around to see if anybody is using the Golang hooks for the Apache Arrow library.

I read an article recently from Wes Mckinny about his involvement with Arrow and how he’s stoked to provide a more flexible Pandas API that would support parallelism out of the box with shared memory, rather than the default pickled approach.

I’d love to see this implemented in golang. I can imagine using the Plasma store API that it would be pretty easy.

xhochy commented 6 years ago

Arrow nowadays has a native Golang implementation that one could build upon: https://github.com/apache/arrow/tree/master/go/arrow

cjnolet commented 6 years ago

Yes, xhochy, that was the point in my suggestion. Since there’s already Golang hooks for Arrow, it would be nice to see them being utilized in a Dataframes implementation for Golang.

arshpreetsingh commented 5 years ago

Yes I looked for arrow with Pandas as well, which is caled Modin, Can anyone tell how tis can be used with This Pandas Library?

kniren commented 4 years ago

I believe https://github.com/tobgu/qframe supports arrow. No support planned for Gota for now.