duckdb / duckdb_azure

Azure extension for DuckDB
MIT License
51 stars 17 forks source link

Querying abfss using the nightly release crash duckdb #74

Closed djouallah closed 2 months ago

djouallah commented 2 months ago

was trying to see if the new abfss format is working, instead it seems to crash duckdb

import duckdb
duckdb.sql(""" select * from 'abfss://xxxxxx@onelake.dfs.fabric.microsoft.com/NY.Lakehouse/Tables/ny/taxi/*.parquet' """)

when I use duckdb 1, i get a runtime error, which is expected but not a crash

gdubya commented 2 months ago

Strange... it works on my machine when I build from source (even from a Fabric table, surprisingly! I was expecting an error related to the endpoint). How is the nigthly build of duckdb put together with the nightly azure plugin?

D select count() from read_parquet("abfss://REDACTED@onelake.dfs.fabric.microsoft.com/REDACTED/Tables/dbo/prices/.parquet"); ┌──────────────┐ │ count_star() │ │ int64 │ ├──────────────┤ │ 3184 │ └──────────────┘

djouallah commented 2 months ago

all good, it was a transient issue, fixed with today nightly

djouallah commented 2 months ago

finally, @samansmink where is my delta , really thank you all !!!

image
samansmink commented 2 months ago

@djouallah delta is only built on the osx platform for nightly builds and has also been temporarily disabled for a bit as well, so it is missing for last night's nightly. OSX binaries should be built tonight or with the upcoming v1.1.0 release of DuckDB.

djouallah commented 2 months ago

@samansmink just to be clear, delta will be available in the 1.1 right ?

samansmink commented 2 months ago

@djouallah yea for sure!

djouallah commented 2 months ago

thank you i nearly had a heart attack :)