[FEATURE] Support for ai_gateway settings of external serving endpoints

[VOVELEE]

Official documentation: https://docs.databricks.com/api/azure/workspace/servingendpoints/putaigateway

Use-cases

Databricks now provide additional controls to be applied on external serving endpoints. It will be great if these configurations are supported via IaC using the vendor terraform provider.

Attempted Solutions

• According to documentation I can't use these settings

Proposal

• Incorporate ai_gateway settings in external model configuration and gradually release to other types when this is officially supported,

References

• See official REST API documentation above :)

[alexott]

It would be useful to add ability to update tags, and rate limits as well...