search

databricks / databricks-cli

(Legacy) Command Line Interface for Databricks
Other
386 stars 234 forks source link

databricks cli cannot access '/dbfs/databricks-datasets/' #257

Open ShumzZ opened 5 years ago

ShumzZ commented 5 years ago

In the notebook, I can use %fs ls dbfs:/ or %sh ls /dbfs/

to see the directory: databricks-datasets

However in cli, when I type databricks fs ls or dbfs ls, I cannot see the above directory. I also tried dbfs ls dbfs:/databricks-datasets/, it prompted an error message:

Error: b'{"error_code":"RESOURCE_DOES_NOT_EXIST","message":"No file or directory exists on path dbfs:/databricks-datasets/."}'

Is is due to some restrictions of CLI or did I get something wrong during the configuration?

FYI: cluster mode: standard pool: None databricks runtime version: 5.5LTS python version:3 worker type: m4.large driver type: m4.large

saipraveen-a commented 4 years ago

Is there any fix for this?

nfx commented 2 years ago

@bogdanghita-db is this a misconfigured cross-account policy or something else?