scrapy / scrapyd

A service daemon to run Scrapy spiders
https://scrapyd.readthedocs.io/en/stable/
BSD 3-Clause "New" or "Revised" License
2.92k stars 569 forks source link

xxx.log can't be found #479

Closed hyliush closed 1 year ago

hyliush commented 1 year ago

xxx/project/spider can be generated, but xxx.log can't be found

scrapy==2.8.0 scrapy-redis==0.7.3 scrapyd==1.3.0 scrapyd-client==1.2.2 scrapydweb==1.4.0

jpmckinney commented 1 year ago

I don't know what you mean. Can you be more specific?

jxlil commented 1 year ago

I didn't check this thoroughly, but in my case, when upgrading Scrapy (2.6.0-> 2.9.0) scrapyd (1.3.0) stopped creating the *.log files

Updating srcapyd to version 1.4.1 seems to fix the bug.

jpmckinney commented 1 year ago

Ah, yes, scrapyd 1.4.0 adds support for scrapy 2.8. scrapy stopped recognizing the SCRAPY_LOG_FILE environment variable, so we switched to tthe LOG_FILE command-line argument.