search

JenspederM / kedro-databricks

A Databricks Plugin for Kedro
MIT License
13 stars 5 forks source link

cli command kedro databricks bundle #54

Closed theoclipse closed 1 month ago

theoclipse commented 1 month ago

Hello,

We found that command kedro databricks bundle does not add parameter --package-name {package_name}.

I found that parameter is added only if kedro version is less than 0.19.8 (in file utils.py function require_databricks_run_script)

Is there a reason for that ? For us, this parameter is still needed, otherwise job is not righly executed on databricks

jpm-halfspace commented 1 month ago

Prior to version 0.19.8, a custom run script was required to run the pipeline on data bricks. After this, we can now utilize the kedro client, which doesn't accept a --package-name argument.