[FEATURE] databricks_model_serving to support instance_profile for amazon bedrock provider

[sasidhar-aws]

It is recommended to use Instance profile instead of Accesskey and Secret Key to configure Amazon Bedrock as served entity in model serving endpoint.

Use-cases

Attempted Solutions

Proposal

resource "databricks_model_serving" "databricks_ai_gateway" {
  name     = "sample"
  config {
    served_entities {
      name                 = "sample"
      external_model {
        provider = "amazon-bedrock"
        task     = "llm/v1/embeddings"
        name     = "titan-embed-text-v1"

        amazon_bedrock_config {
          bedrock_provider = "amazon"
          aws_region       = "us-west-2"
          instance_profile_arn = "ARN"
        }
      }
    }
  }
}

References

[alexott]

This field isn't the part of the API spec yet

[sasidhar-aws]

I see instance_profile_arn parameter available in served_entities block, however it is not being used. I see there is option in UI, to select instance profile and create model serving endpoint.