Azure / Azure-Verified-Modules

Azure Verified Modules (AVM) is an initiative to consolidate and set the standards for what a good Infrastructure-as-Code module looks like. Modules will then align to these standards, across languages (Bicep, Terraform etc.) and will then be classified as AVMs and available from their respective language specific registries.
https://aka.ms/AVM
MIT License
367 stars 89 forks source link

[Module Proposal]: `avm/ptn/ai-platform/baseline` #1150

Closed cecheta closed 4 months ago

cecheta commented 5 months ago

Check for previous/existing GitHub issues/module proposals

Check this module doesn't already exist in the module indexes

Bicep or Terraform?

Bicep

Module Classification?

Pattern Module

Module Name

avm/ptn/ai-platform/baseline

Module Details

The AVM-PTN-AIPlatform module aims to provide a secure and scalable environment for deploying AI applications on Azure. This module will encompass all essential components required for building, managing, and observing AI solutions, including a machine learning workspace, observability tools, and necessary data management services. By integrating with Microsoft Entra ID for secure identity management and utilizing private endpoints for services like Key Vault and Blob Storage, the module ensures secure communication and data access.

343109370-728f1963-feef-4db3-9c09-446d1c05b031

The architecture includes a virtual network with dedicated subnets for different functionalities, such as a jump box subnet and private endpoint subnet, with secure remote access provided through Azure Bastion. Managed AI services within the Azure AI Hub connect to managed online endpoints, compute instances, and serverless services, offering a scalable solution for AI project management. Additionally, the module integrates Azure Storage Account, Azure Key Vault, and Azure Container Registry for comprehensive data management, while Azure Monitor and Application Insights provide real-time monitoring and observability of AI applications and resources.

Overall, the AVM-PTN-AIPlatform module offers a robust pattern for deploying AI applications on Azure, leveraging Azure’s extensive suite of services and features to provide a comprehensive environment for AI development. By ensuring enhanced security through private endpoints and managed identities, and by providing scalable and efficient management tools, this module facilitates the seamless deployment and operation of AI solutions at scale.

Do you want to be the owner of this module?

Yes

Module Owner's GitHub Username (handle)

cecheta

(Optional) Secondary Module Owner's GitHub Username (handle)

ross-p-smith

cecheta commented 5 months ago

This will be implemented together with @Nepomuceno in https://github.com/Azure/Azure-Verified-Modules/issues/1145

matebarabas commented 5 months ago

Hi @cecheta,

Thanks for requesting/proposing to be an AVM module owner!

We just want to confirm you agree to the below pages that define what module ownership means:

Any questions or clarifications needed, let us know!

If you agree, please just reply to this issue with the exact sentence below (as this helps with our automation πŸ‘):

"I CONFIRM I WISH TO OWN THIS AVM MODULE AND UNDERSTAND THE REQUIREMENTS AND DEFINITION OF A MODULE OWNER"

Thanks,

The AVM Core Team

RR

cecheta commented 5 months ago

I CONFIRM I WISH TO OWN THIS AVM MODULE AND UNDERSTAND THE REQUIREMENTS AND DEFINITION OF A MODULE OWNER

matebarabas commented 5 months ago

Hi @cecheta,

Thanks for confirming that you wish to own this AVM module and understand the related requirements and responsibilities!

Before starting development, please ensure ALL the following requirements are met.

Please use the following values explicitly as provided in the module index page:

Check if this module exists in the other IaC language. If so, collaborate with the other owner for consistency. πŸ‘

You can now start the development of this module! βœ… Happy coding! πŸŽ‰

Please respond to this comment and request a review from the AVM core team once your module is ready to be published! Please include a link pointing to your PR, once available. πŸ™

Any further questions or clarifications needed, let us know!

Thanks,

The AVM Core Team

cecheta commented 5 months ago

Hi @matebarabas , do I need to wait for the index to be updated?

https://github.com/Azure/Azure-Verified-Modules/blob/main/docs/static/module-indexes/BicepPatternModules.csv

segraef commented 5 months ago

Thank you for the proposal @cecheta, considering PMNFR2, how are you planning to implement the Azure AI Studio Hub, using https://github.com/Azure/bicep-registry-modules/tree/main/avm/res/machine-learning-services/workspace? If so I think the api version needs to be updated to at least 2023-04-01 to support Azure AI Studio Hub, correct me if I'm wrong.

cecheta commented 5 months ago

Hi @segraef , yes that's correct

I have a PR open looking to add the necessary fields to the resource to help with this

https://github.com/Azure/bicep-registry-modules/pull/2590

matebarabas commented 4 months ago

Hi @matebarabas , do I need to wait for the index to be updated?

https://github.com/Azure/Azure-Verified-Modules/blob/main/docs/static/module-indexes/BicepPatternModules.csv

@cecheta, the index has just been updated. To answer your question: generally speaking, you can start the development before the updated index is published, but for certain things (e.g., telemetry Id prefix), you'll need to see the assigned values in the updated index. These are now available for your module. Thanks for your patience!

cecheta commented 4 months ago

Hi @cecheta,

Thanks for confirming that you wish to own this AVM module and understand the related requirements and responsibilities!

Before starting development, please ensure ALL the following requirements are met.

Please use the following values explicitly as provided in the module index page:

  • For your module:

    • ModuleName - for naming your module
    • TelemetryIdPrefix - for your module's telemetry
  • For your module's repository:

    • Repo name and folder path are defined in RepoURL
    • Create GitHub teams for module owners and contributors and grant them permissions as outlined here.
    • Grant permissions for the AVM core team and PG teams on your GitHub repo as described here.

Check if this module exists in the other IaC language. If so, collaborate with the other owner for consistency. πŸ‘

You can now start the development of this module! βœ… Happy coding! πŸŽ‰

Please respond to this comment and request a review from the AVM core team once your module is ready to be published! Please include a link pointing to your PR, once available. πŸ™

Any further questions or clarifications needed, let us know!

Thanks,

The AVM Core Team

Hi @matebarabas , I've raised the first PR for the module

https://github.com/Azure/bicep-registry-modules/pull/2694

microsoft-github-policy-service[bot] commented 4 months ago

[!IMPORTANT] @cecheta, this issue has not had any activity in the last 3 weeks. Please feel free to reach out to the AVM core team should you have any questions or need any help with the development of this module.

[!TIP] To silence this notification, provide an update every 3 weeks on the Module Proposal issue, or add the "Status: Long Term :hourglass_flowing_sand:" label.

cecheta commented 4 months ago

Following https://github.com/Azure/bicep-registry-modules/pull/2900, the majority of the module will have been completed, therefore the issue can be closed as completed.

matebarabas commented 4 months ago

Thank you for your work @cecheta! I'm closing this issue now.