Azure / NoOpsAccelerator

A flexible, Infrastructure-as-Code foundation that assists customers with the development and deployment of opinionated infrastructure models that are secure, well-governed, and simple to maintain.
MIT License
63 stars 32 forks source link

Create container platform and data processing example #24

Open sstjean opened 2 years ago

sstjean commented 2 years ago

Example Request

Please describe the need/value of this example

Many customers need an enclave where they can run containerized workloads and the data from those apps can also be dropped into a data lake for "big data" processing to gain knowledge from the combined raw data.

What Landing Zone does it need?

SCCA-Compliant hub and three spoke (MLZ-equivalent) Landing Zone

What goes into Shared Services (if anything)?

Azure Data Lake Synapse

Which Workloads does it contain?

AKS cluster with internal ingress controller attached to a spoke network peered to the hub network. Public IP on the hub firewall that directs traffic to the AKS cluster ingress controller

timothymeyers commented 2 years ago

Other shared services to consider:

Other workloads to consider:

Additionally, the Data scientists would be using Azure Machine Learning Workspaces attached to DSVMs, DSVM Scale Sets, and the AKS compute cluster

sstjean commented 2 years ago

@timothymeyers - Wouldn't the storage account (for prepared data sets to land) be covered by the Data Lake? Asking for a friend. 😉

timothymeyers commented 2 years ago

Sure sure, yes yes, friend.

sstjean commented 1 year ago

Updated to change from an Enclave request to an Example request given the new format.