search

my8100 / scrapydweb

Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI. DEMO :point_right:
https://github.com/my8100/files
GNU General Public License v3.0
3.16k stars 565 forks source link

Not able to see stats section of the job #203

Closed RahulBadenkal closed 2 years ago

RahulBadenkal commented 2 years ago

Describe the bug Running scrapydweb locally (with ENABLE_LOGPARSER=True). I am able to see the logs file in the ui but the stats section of a job is not visible. Also the stats data inside the database/stat folder is empty. { "_head": 100, "crawler_engine": {}, "crawler_stats": {}, "datas": [], "finish_reason": "N/A", "first_log_time": "2022-09-28 02:03:58", "first_log_timestamp": 1664310838, "head": "2022-09-28 02:03:58 [scrapy.utils.log] INFO: Scrapy 2.6.2 started (bot: way_crawlers)\n2022-09-28 02:03:59 [scrapy.utils.log] INFO: Versions: lxml 4.9.1.0, libxml2 2.9.12, cssselect 1.1.0, parsel 1.6.0, w3lib 2.0. }

Screenshots Untitled

RahulBadenkal commented 2 years ago

Ok, my bad. I had set the log level at error. Restoring to default solved it