Closed chiragkanhasoft closed 3 years ago
i have enabled only error log to print using below command celery -A scraper_api worker -l error
when i run scraping as celery task and i have enable only error log and in scrapy setting i have disabled log still it is printing all logs.
Try adjusting the setting and passing it to the Processor() constructor.
Processor()
settings = scrapy.settings.Settings(values={'LOG_LEVEL': 'WARNING'}) processor = Processor(settings=settings)
i have enabled only error log to print using below command celery -A scraper_api worker -l error
when i run scraping as celery task and i have enable only error log and in scrapy setting i have disabled log still it is printing all logs.