PrefectHQ / prefect-aws

Prefect integrations with AWS.
https://PrefectHQ.github.io/prefect-aws/
Apache License 2.0
85 stars 40 forks source link

Support MinIO Credentials block as credentials for `push_to_s3` and `pull_from_s3` #366

Closed kevingrismore closed 10 months ago

kevingrismore commented 10 months ago

When using prefect.yaml, allows the user to supply a MinIO Credentials block name for the push_to_s3 and pull_from_s3 deployment steps.

Example

build: null

push:
  - prefect_aws.deployments.steps.push_to_s3:
      bucket: test
      folder: my-project
      credentials: "{{ prefect.blocks.minio-credentials.test-creds }}"

pull:
  - prefect_aws.deployments.steps.pull_from_s3:
      bucket: test
      folder: my-project
      credentials: "{{ prefect.blocks.minio-credentials.test-creds }}"

deployments:
  - name: minio-stored-deployment
    entrypoint: flow.py:my_minio_flow
    work_pool:
      name: my-ecs-pool
    is_schedule_active: true

Screenshots

image image

Docstring update for push_to_s3 and pull_from_s3: image

Checklist