Phoenix provides MLOps and LLMOps insights at lightning speed with zero-config observability. Phoenix provides a notebook-first experience for monitoring your models and LLM Applications by providing:
Table of contents:
You have a few options for getting started with this template. The quickest way to get started is GitHub Codespaces, since it will setup all the tools for you, but you can also set it up locally. You can also use a VS Code dev container
You can run this template virtually by using GitHub Codespaces. The button will open a web-based VS Code instance in your browser:
Open a terminal window
Sign into your Azure account:
azd auth login --use-device-code
Provision the Azure resources and deploy your code:
azd config set alpha.resourceGroupDeployments on
# azd env set PERSISTENCE true
azd provision
To view the endpoint, follow the "Phoenix UI link"
Optionally, you can configure a CI/CD pipeline:
azd pipeline config
A related option is VS Code Dev Containers, which will open the project in your local VS Code using the Dev Containers extension:
Start Docker Desktop (install it if not already installed)
In the VS Code window that opens, once the project files show up (this may take several minutes), open a terminal window.
Sign into your Azure account:
azd auth login
Provision the Azure resources and deploy your code:
azd config set alpha.resourceGroupDeployments on
# azd env set PERSISTENCE true
azd provision
To view the endpoint, follow the "Phoenix UI link"
Optionally, you can configure a CI/CD pipeline:
azd pipeline config
Run this command to download the project code:
azd init -t Arize-ai/phoenix-on-azure
Note: this command will initialize a git repository, so you do not need to clone this repository.
Create a Python virtual environment and install the required packages:
pip install -r requirements.txt
Sign into your Azure account:
azd auth login
Create a new azd environment:
azd env new
Enter a name that will be used for the resource group.
This will create a new folder in the .azure
folder, and set it as the active environment for any calls to azd
going forward.
Run this command to provision all the resources:
If you want your data to be persisted between deployments, you can set the PERSISTENCE
environment variable to true
before running the provision
command.
azd config set alpha.resourceGroupDeployments on
# azd env set PERSISTENCE true
azd provision
This will create a new resource group, and create the Azure Container App and PostgreSQL Flexible server inside that group.
It will use the init.sh
and post.sh
hooks to set up default secrets, and pass the necessary environment variables to the Azure Container App.
In order to deploy this template, you will need to turn on the resource group scoped deployments alpha feature. Learn more about azd's feature versioning strategy.
azd config set alpha.resourceGroupDeployments on
If you want your data to be persisted between deployments, you can set the PERSISTENCE
environment variable to true
before running the up
command:
azd env set PERSISTENCE true
Provision and deploy the project to Azure:
azd up
This will create a new resource group, and create the Azure Container App and PostgreSQL Flexible server inside that group.
It will use the init.sh
and post.sh
hooks to set up default secrets, and pass the necessary environment variables to the Azure Container App.
To view the endpoint, follow the "Phoenix UI link"
Optionally, you can configure a CI/CD pipeline:
azd pipeline config
You can estimate the cost of this project's architecture with Azure's pricing calculator
Phoenix is an external project and is not affiliated with Microsoft.