Orchestration of Data Pipelines using Apache AIrflow - Githubissues

PyDataPune / Talks

Official repo for proposals

14 stars 3 forks source link

Orchestration of Data Pipelines using Apache AIrflow #51

Open mayankskb opened 4 years ago

mayankskb commented 4 years ago

Points that we will cover

What is Data Pipelines
Directed Acyclic Graphs
Making DAGs
Scheduling of jobs
Orchestration of data pipelines based on the priority of tasks
Using Operators and Defining your custom operators
Monitoring Data Pipelines