This repository serves as the provider of the worker Docker image definitions used by pangeo-forge
Bakeries and their dask clusters
All images are based on the pangeo-notebook
image found here
The following image tags for pangeo-forge-bakery-images
are currently available on the pangeo
DockerHub:
Image Tag | Core Package Versions | Size |
---|---|---|
pangeonotebook-2021.05.15_prefect-0.14.19_pangeoforgerecipes-0.3.4 |
pangeo-notebook - 2021.05.15 prefect - 0.14.19 pangeo-forge-recipes - 0.3.4 |
|
pangeonotebook-2021.06.05_prefect-0.14.22_pangeoforgerecipes-0.4.0 |
pangeo-notebook - 2021.06.05 prefect - 0.14.22 pangeo-forge-recipes - 0.4.0 |
|
pangeonotebook-2021.07.17_prefect-0.14.22_pangeoforgerecipes-0.5.0 |
pangeo-notebook - 2021.07.17 prefect - 0.14.22 pangeo-forge-recipes - 0.5.0 |
These tags are for use within a deployed pangeo-forge
Bakery. You can find an AWS Bakery here and an Azure Bakery here.
Bakeries require the containers that are pulling and running Prefect Flows to contain the necessary dependencies to successfully do this. On deployment of your Bakery, you should point your Agent and Worker containers to one of these pangeo-forge-bakery-images
tags.
For example, you could deploy the Azure Bakery linked earlier and set AZURE_BAKERY_IMAGE
in your .env
like so:
AZURE_BAKERY_IMAGE="pangeo/pangeo-forge-bakery-images:pangeonotebook-2021.05.15_prefect-0.14.19_pangeoforgerecipes-0.3.4"
To develop on this project, you should have the following installed:
If you're developing on MacOS, all of the above can be installed using homebrew
If you're developing on Windows, we'd recommend using either Git BASH or Windows Subsystem for Linux
To build an image, select the tag from the table above that you wish to build, then in the root of the repo run:
$ make build-image image=<image-tag>
To successfully push an image tag to the pangeo/pangeo-forge-bakery-images
registry, you will need two things:
pangeo
DockerHub organisationWhen you have both of these, you'll need to login with:
$ docker login --username <your-username> --password <your-personal-access-token>
To push an image, select the tag from the table above that you wish to push, then in the root of the repo run:
$ make push-image image=<image-tag>