databrickslabs / dbx

🧱 Databricks CLI eXtensions - aka dbx is a CLI tool for development and advanced Databricks workflows management.
https://dbx.readthedocs.io
Other
437 stars 119 forks source link

Request for Deployment YAML #859

Open Escoto opened 7 months ago

Escoto commented 7 months ago

Expected Behavior

I have a long list of tables to process, and we want to process them in separate tasks. I am wondering if there is a way to configure them as a list and dynamically get all the tasks created

image

Current Behavior

I have to configure a large number of tasks independently.

Steps to Reproduce (for bugs)

Context

Deploying a Job with a large number of identical tasks, just with different parameters

Your Environment