search

vincentnam / docker_datalake

Datalake
Other
27 stars 11 forks source link

History for every process data #61

Open Latamen opened 3 years ago

Latamen commented 3 years ago

History for every process Data done in Apache Airflow after every upload file. Not too much code but a lot of code and tests done in Modis server.

vincentnam commented 3 years ago

@Latamen It may be helpful :

"def on_success_callback(context):" in https://github.com/vincentnam/docker_datalake/blob/usecase-DataNoosDemo/apache_airflow/dags/dag_creator.py

I forgot to add callback in the main version (my bad).

In the official Airflow documentation https://airflow.apache.org/docs/apache-airflow/stable/_api/airflow/models/baseoperator/index.html?highlight=on_failure_callback