Azure / spark-cdm-connector

MIT License
76 stars 33 forks source link

[Enhansement] Support local directory #147

Open scrmz opened 1 year ago

scrmz commented 1 year ago

Did you read the pinned issues and search the error message?

No, but I will read and search it now before creating an issue.

Summary of issue

The ADLS is mounted on a Azure Databricks cluster in /mnt/data/ directory. However, following the documentation, I still have to use a connection between my spark and the data lake through a SAS key or whatever.

Can it be possible to handle this kind of feature ?

Error stack trace

No response

Platform name

Azure Databricks

Spark version

3.3

CDM jar version

?

What is the format of the data you are trying to read/write?

.csv