search

h2oai / db-benchmark

reproducible benchmark of database-like ops
https://h2oai.github.io/db-benchmark
Mozilla Public License 2.0
321 stars 85 forks source link

arrow internal error in groupby 1e9 k=2 #190

Open jangorecki opened 3 years ago

jangorecki commented 3 years ago

groupby 1e9 k=2 happens when computing question 3

Error in Table__to_dataframe(x, use_threads = option_use_threads()) : 
  Capacity error: array cannot contain more than 2147483646 bytes, have 2147483652
Calls: system.time ... as.data.frame -> as.data.frame.Table -> Table__to_dataframe