search

jschnurr / scrapyscript

Run a Scrapy spider programmatically from a script or a Celery task - no project required.
MIT License
121 stars 26 forks source link

it is printing all log #8

Closed chiragkanhasoft closed 3 years ago

chiragkanhasoft commented 4 years ago

i have enabled only error log to print using below command celery -A scraper_api worker -l error

when i run scraping as celery task and i have enable only error log and in scrapy setting i have disabled log still it is printing all logs.

image

jschnurr commented 3 years ago

Try adjusting the setting and passing it to the Processor() constructor.

settings = scrapy.settings.Settings(values={'LOG_LEVEL': 'WARNING'})
processor = Processor(settings=settings)