delta-incubator / delta-dotnet

DeltaLake bindings for dotnet based on delta-rs
Apache License 2.0
25 stars 6 forks source link

Connecting to Azure Data Lake Gen2 with Managed Identity #76

Closed akulOn closed 1 month ago

akulOn commented 1 month ago

Hi, I'm having some trouble connecting to Azure with Managed Identity.

I took a look at this PR in the delta-rs repo: https://github.com/delta-io/delta-rs/issues/600, but I can't get it to work.

I've tried using the az:/// path, but no luck.

Environment.SetEnvironmentVariable("AZURE_STORAGE_ACCOUNT_NAME","templake");

string sourcePath = "abfss://temp@templake.dfs.core.windows.net/branches/people/";

using var runtime = new DeltaRuntime(RuntimeOptions.Default); using var table = await DeltaTable.LoadAsync( runtime, sourcePath, new TableOptions(), CancellationToken.None);

foreach (var file in table.Files()) { Console.WriteLine(file); }

mdrakiburrahman commented 1 month ago

I can take a look at this one, I'm trying to solve an identical problem

MrPowers commented 1 month ago

Thanks @mdrakiburrahman. Assigned you this one!

mdrakiburrahman commented 1 month ago

PR is here: https://github.com/delta-incubator/delta-dotnet/pull/81