alexandraabbas
commented
3 years ago Hey @silviodc - yes, Airflow abstracts these tools se we don't need to interact with them directly. I also had to learn more about Celery when configuring Airflow in production. I'll consider adding these next time, thanks a lot!
Hello I haven't seen frameworks like Celery https://docs.celeryproject.org/en/stable/index.html Or spring https://spring.io/projects/spring-cloud-dataflow#overview
In my personal experience I had to create many batch pipelines, using these. Now with airflow I'm planning to move some. But still there are some legacy code I can't change :) so knowledge to maintain them are necessary.