leopardslab / CrawlerX

CrawlerX - Develop Extensible, Distributed, Scalable Crawler System which is a web platform that can be used to crawl URLs in different kind of protocols in a distributed way.
Apache License 2.0
22 stars 16 forks source link

Remove apache airflow artifacts #120

Closed beshiniii closed 3 years ago

beshiniii commented 3 years ago

Description

Remove airflow artefacts since project has moved with celery beat and workers