Lazy loading for Arrow.jl

tecosaur / DataToolkit.jl

Reproducible, flexible, and convenient data management

https://tecosaur.github.io/DataToolkit.jl

78 stars 4 forks source link

Lazy loading for Arrow.jl #40

Open jfb-h opened 4 months ago

jfb-h commented 4 months ago

In the wake of tecosaur/DataToolkitCommon.jl#16 you activated lazy loading for ArchGDAL so that .gpkg data can be loaded even when ArchGDAL was not explicitly imported by the user before. The same seems to be the issue for Arrow files where currently you get an ERROR: TransformerError: Data set ... could not be loaded in any form. when you don't load either the Arrow or DataFrames package first.

tecosaur commented 1 month ago

I think it should suggest now that you need to load the Arrow or DataFrames.

Regarding ArchGDAL, IIRC you still need to load it first? At least in the unit tests it is.

jfb-h commented 1 month ago

I'll check again, maybe I got something mixed up. When and how to load and add packages felt a little bit confusing sometimes, if I remember correctly.