databricks / run-notebook

Apache License 2.0
49 stars 19 forks source link

pass parameters to notebook #39

Closed sarmad-bhi closed 1 year ago

sarmad-bhi commented 1 year ago

Any example to pass parameters to notebook input widgets ?

mingyu89 commented 1 year ago

For example, the following step in a github action

    - name: step_name
      uses: databricks/run-notebook@v0
      with:
        databricks-host: ${{ secrets.HOST }}
        databricks-token: ${{ secrets.TOKEN }}
        local-notebook-path: notebooks/MyNotebook.py
        git-commit: ${{ github.sha }}
        new-cluster-json: >
          {
            "spark_version": "10.2.x-cpu-ml-scala2.12",
             "node_type_id": "i3.4xlarge",
             "aws_attributes": {
               "availability": "ON_DEMAND"
             },
             "num_workers": 0,
             "spark_conf": {
               "spark.databricks.cluster.profile": "singleNode",
               "spark.master": "local[*, 4]",
               "spark.python.worker.reuse": "false"
             },
             "custom_tags": {
               "ResourceClass": "SingleNode"
             }
          }
        notebook-params-json: >
          {
            "run_id": "my_id",
            "source": "source",
            "host": "host",
            "endpoint_name": "endpoint"
          }

The notebook-params-json is the notebook input parameters.