I would like to be able to perform operations such as these:
using DataFrames
N=3
myDT = DataFrame(group = repeat('A':'C',outer=N), x = 1:(3*N) ) # create a dataframe
myDT.y = myDT.x .* rand(3*N) # add a new column z
myDT[myDT.group .== 'A', :y] = 0 # Replace y values when group == 'A'
With JuliaDB
N=10^9
table((group = repeat('A':'C',outer=N), x = 1:(3*N) ))
but it consumes all my RAM and produces the error
ERROR: OutOfMemoryError()
The docs show how to load data from csv files but I haven't seen how to the use out-of-core functionality to create tables (or whatever structure) larger than memory and save the results.
How can I create a large table using JuliaDB?
I would like to be able to perform operations such as these:
With JuliaDB
The docs show how to load data from csv files but I haven't seen how to the use out-of-core functionality to create tables (or whatever structure) larger than memory and save the results.