I am newbie where I would need to formulate a solution for bigQuery processing using Airflow and Looper. I do not know the full details yet but this project would require loading target tables by repeatedly looping through different pipelines for fetching data from different sources. I do see that it is possible to add Python plugins to airflow and probably modify UI for making it an integrated platform. Could you please let me know if it could be done where Looper becomes a plugin for Airflow?
Hi,
I am newbie where I would need to formulate a solution for bigQuery processing using Airflow and Looper. I do not know the full details yet but this project would require loading target tables by repeatedly looping through different pipelines for fetching data from different sources. I do see that it is possible to add Python plugins to airflow and probably modify UI for making it an integrated platform. Could you please let me know if it could be done where Looper becomes a plugin for Airflow?