MLflow with basic auth

This project is ARCHIVED and it will not receive maintenance anymore because the MLflow finally supports basic authentication natively! \o/

version: "3.9"

services:
  mlflow:
    image: ghcr.io/mlflow/mlflow:v2.5.0
    ports:
      - 5000:5000
    command: mlflow server --host 0.0.0.0 --app-name basic-auth

Find further details in MLflow Authentication — MLflow 2.5.0 documentation.

A dockerized MLflow Tracking Server with basic auth (username and password).

You will have three options to deploy the server: AWS, Heroku, and local.

We provide a Terraform stack that can be easily used to deploy the MLflow Tracking Server.

NOTE: This project is not intended to be used for production deployments. It is intended to be used for testing and development.

Environment Variables

The environment variables below are required to deploy this project.

Deploying MLflow Tracking Server

AWS

Prerequisites

• AWS Account
• AWS CLI
• Terraform CLI

To deploy MLflow, you'll need to:

1. Create an AWS account if you don't already have one.

2. Configure AWS CLI to use your AWS account.

3. Clone this repository.

git clone https://github.com/DougTrajano/mlflow-server.git

4. Open mlflow-server/terraform folder.

cd mlflow-server/terraform

5. Run the following command to create all the required resources:

terraform init
terraform apply -var mlflow_username="YOUR-USERNAME" -var mlflow_password="YOUR-PASSWORD"

Multiple usernames and passwords can also be specified in a comma-delimited string:

terraform apply -var mlflow_username="USERNAME1,USERNAME2,USERNAME3" -var mlflow_password="PASSWORD1,PASSWORD2,PASSWORD3"

See a full list of variables that can be used in terraform/variables.tf.

6. Type "yes" when prompted to continue.

Plan: 21 to add, 0 to change, 0 to destroy.

Changes to Outputs:
  + artifact_bucket_id = (known after apply)
  + mlflow_password    = (sensitive value)
  + mlflow_username    = "doug"
  + service_url        = (known after apply)
  + status             = (known after apply)

Do you want to perform these actions?
  Terraform will perform the actions described above.
  Only 'yes' will be accepted to approve.

  Enter a value: yes

This will create the following resources:

• An S3 bucket is used to store MLflow artifacts.
• An [IAM role and policy that allows MLflow to access the S3 bucket.
• An Aurora RDS Serverless database (PostgreSQL) is used to store MLflow data.
• An App Runner that will run the MLflow Tracking Server.
• (Optional) A set of network resources such as VPC, Subnet, and Security group.

Heroku

Prerequisites

• Heroku Account
• AWS Account
  • The Heroku deployment will use an Amazon S3 bucket for storing the MLflow tracking data.
• AWS CLI
• Terraform CLI

1. Create an AWS account if you don't already have one.

2. Configure AWS CLI to use your AWS account.

3. Clone this repository.

git clone https://github.com/DougTrajano/mlflow-server.git

4. Open mlflow-server/terraform folder.

cd mlflow-server/terraform

5. Run the following command to create only the S3 bucket

terraform init
terraform apply -var environment="heroku" -target="module.s3"

6. Type "yes" when prompted to continue.

Plan: 5 to add, 0 to change, 0 to destroy.

Changes to Outputs:
  + artifact_bucket_id = (known after apply)

Do you want to perform these actions?
  Terraform will perform the actions described above.
  Only 'yes' will be accepted to approve.

  Enter a value: yes

2. Create an IAM Policy for the S3 bucket as follows:

3. Create an IAM User and attach the IAM Policy previously created.

Take note of the IAM User access key and secret key, you'll need them in the step 5.

4. Click on the "Deploy to Heroku" button below.

5. Follow the instructions on the new page to create an MLflow Tracking Server.

Local

Prerequisites

• Docker and Docker Compose.

1. Clone this repository.

git clone https://github.com/DougTrajano/mlflow-server.git

2. Open the mlflow-server folder.

cd mlflow-server

3. Run the following command to create all the required resources:

docker-compose up -d --build

Using your deployed MLflow

The link that you will use to access the MLflow Tracking Server will depend on the deployment method you choose.

• For AWS, the link will be something like https://XXXXXXXXX.aws-region.awsapprunner.com/.
  • You can find it in the AWS App Runner console.
• For Heroku, the link will be something like https://XXXXXXXXX.herokuapp.com/.
  • You can find it in the Heroku dashboard.
• For Local, the link will be something like http://localhost:80/.

Also, you can track your experiments using MLflow API.

import os
import mlflow

os.environ["MLFLOW_TRACKING_URI"] = "<<YOUR-MLFLOW-TRACKING-URI>>"
os.environ["MLFLOW_EXPERIMENT_NAME"] = "<<YOUR-EXPERIMENT-NAME>>"
os.environ["MLFLOW_TRACKING_USERNAME"] = "<<YOUR-MLFLOW-USERNAME>>"
os.environ["MLFLOW_TRACKING_PASSWORD"] = "<<YOUR-MLFLOW-PASSWORD>>"

# AWS AK/SK are required to upload artifacts to S3 Bucket
os.environ["AWS_ACCESS_KEY_ID"] = "<<AWS-ACCESS-KEY-ID>>"
os.environ["AWS_SECRET_ACCESS_KEY"] = "<<AWS-SECRET-ACCESS-KEY>>"

SEED = 1993

mlflow.start_run()
mlflow.log_param("seed", SEED)
mlflow.end_run()

References

• Managing your machine learning lifecycle with MLflow and Amazon SageMaker | AWS Machine Learning Blog
• Introducing AWS App Runner
• MLflow Documentation (current version: 1.27.0)
• soundsensing/mlflow-easyauth: Deploy MLflow with HTTP basic authentication using Docker