Closed davidgasquez closed 1 year ago
Hrm, it's possible that after @AlexanderVR's most recent PR, this will (almost) just work? We may need to generalize this check to look for pyarrow.dataset.Dataset
as well?
Sweet! It works when installing dbt-duckdb
from GitHub. Thanks a lot @jwills!
From the docs:
Since
pyarrow.table
type won't work with larger than memory datasets, this might be a good alternative. I was also thinking about Polars but wanted to check first if this was easier to implement.