search

Azure / Azure-DataFactory

Other
479 stars 585 forks source link

Feature - Add driver_instance_pool_id parameter to Databricks' Linked Services #408

Open davidvesp opened 2 years ago

davidvesp commented 2 years ago

Nowadays we can select only the instance_pool_id in the Databricks' Linked Service, but something we want to select a different pool for the driver to save money (i.e.: most of the work is done in the workers and driver is only used to coordinate the workers tasks). From the API documentation (https://docs.microsoft.com/en-us/azure/databricks/dev-tools/api/2.0/jobs) it's possible to set driver_instance_pool_id and we have tested that it's works as we expected.

dzhemaptula-tomtom commented 9 months ago

+1

Has there been any updates on this?