search

GSS-Cogs / DataEngineering_Airflow_Alpha

0 stars 0 forks source link

Task: Identify Training Resources #18

Open MartynBSpooner opened 1 year ago

MartynBSpooner commented 1 year ago

Wider team being introduced the original Docker based examples created by J and myself for an initial understanding of the software etc.

MartynBSpooner commented 1 year ago

Initial References: https://cloud.google.com/composer/docs

I don't believe courses are required for introduction as vendor / Google documentation is satisfactory for to get initial setup etc. However https://www.pluralsight.com/courses/productionalizing-data-pipelines-apache-airflow could be useful for the next step in learning as it covers topics to build pipelines more resilient and predictable, learn how to distribute tasks with Celery and Kubernetes Executors, understand how to build data pipelines to a production grade.

MartynBSpooner commented 1 year ago

Not documented at present. Learning / training document will evolve once generated.