enables external location and named credential in databricks

dlt-hub / dlt

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

https://dlthub.com/docs

Apache License 2.0

2.65k stars 176 forks source link

enables external location and named credential in databricks #1755

Closed rudolfix closed 2 months ago

rudolfix commented 2 months ago

Description

This PR enables external locations and named credential in Databricks. It does a few more things as our handling of fsspec urls prevented the usage of abfss://container@account.../path locations which Databricks required:

fsspec code got simplified, url structure-aware make_url method got added
fixes #1703
fixes #1754 (@sh-rp please add your tests to this PR)
@VioletM remote_uri in trace got renamed to remote_url

netlify[bot] commented 2 months ago

Deploy Preview for dlt-hub-docs canceled.

Name	Link
Latest commit	73e57631edce590036ae4d656ce08f34d3c52e13
Latest deploy log	https://app.netlify.com/sites/dlt-hub-docs/deploys/66cf0045143ad30008600ab3

dlt-hub / dlt

enables external location and named credential in databricks #1755

Description

✅ Deploy Preview for dlt-hub-docs canceled.

Deploy Preview for dlt-hub-docs canceled.