Create nightly manager - Githubissues

templateflow / python-manager

A toolbox to upload and update the TemplateFlow repository

Apache License 2.0

1 stars 2 forks source link

Create nightly manager #4

Closed oesteban closed 4 years ago

oesteban commented 4 years ago

Write some code to run on circle or travis daily:

Maintains S3 buckets in sync with the repo.
Updates the root directory if there are changes in the subdatasets
Updates the client's skeleton (and removes such responsibility from the client's CircleCI workflow)

Additionally, when a new release of the manager is cut:

Cut a new release of the TF repository (https://github.com/templateflow/templateflow) by pushing a new annotated tag.
Perhaps hit some endpoint to notify @yarikoptic's crawlers that a new release of ///templateflow is ready?

yarikoptic commented 4 years ago

yeah, I am yet to establish auto updates/recrawling of some datasets for which I know that it should just work... this could be the first one to tackle. Most likely to start with could be just a cron job on my end. Since if there is no changes - there would be not much traffic, could probably just run it quite frequently (hourly?)

oesteban commented 4 years ago

hourly is way too much for templateflow - no traffic at all. But I guess that will allow you to check faster if things are okay.

oesteban commented 4 years ago

The three targets specified above are currently handled by GH-actions automations:

Maintains S3 buckets in sync with the repo.

[x] templateflow/templateflow.

Updates the root directory if there are changes in the subdatasets

[x] Done within each template's repo.

Updates the client's skeleton (and removes such responsibility from the client's CircleCI workflow)

[x] templateflow/templateflow.