Read a JDFFile in chunks

xiaodaigh / JDF.jl

Julia DataFrames serialization format

MIT License

88 stars 9 forks source link

Closed gcalderone closed 2 years ago

gcalderone commented 2 years ago

Is it possible (or will someday be possible) to read a JDFFile in chunks?

I.e., something similar to:

df = DataFrame(JDF.load("iris.jdf", start=2, length=2))

to read just the 2nd and 3rd row.

Thanks!

xiaodaigh commented 2 years ago

Yeah. Might be possible. I am thinking through it. But for small ranges, it's not gonna be super efficient.