search

my8100 / logparser

A tool for parsing Scrapy log files periodically and incrementally, extending the HTTP JSON API of Scrapyd.
GNU General Public License v3.0
89 stars 22 forks source link

JSONDecodeError #20

Closed mtabbasi closed 2 years ago

mtabbasi commented 3 years ago

When I run my job I receive JSONDecodeError from logparser 

{"log_count/INFO": 23, "spidermon/validation/validators": 1, "spidermon/validation/validators/item/jsonschema": True, "start_time": "datetime.datetime(2021, 9, 19, 19, 15, 33, 367214)", "memusage/startup": 131145728, "memusage/max": 361840640, "scheduler/enqueued/memory": 39, "scheduler/enqueued": 39, "scheduler/dequeued/memory": 35, "scheduler/dequeued": 35, "downloader/request_count": 978, "downloader/request_method_count/GET": 978, "downloader/request_bytes": 382594, "downloader/response_count": 76, "downloader/response_status_count/200": 59, "downloader/response_bytes": 93021974, "httpcompression/response_bytes": 18045790, "httpcompression/response_count": 18, "response_received_count": 59, "request_depth_max": 2, "downloader/response_status_count/301": 17, "file_count": 41, "file_status_count/downloaded": 41, "log_count/WARNING": 18, "downloader/exception_count": 22, "downloader/exception_type_count/twisted.web._newclient.ResponseFailed": 18, "retry/count": 22, "retry/reason_count/twisted.web._newclient.ResponseFailed": 18, "downloader/exception_type_count/twisted.internet.error.TimeoutError": 4, "retry/reason_count/twisted.internet.error.TimeoutError": 4}
Traceback (most recent call last):
  File "/home/ubuntu/crawl/lib/python3.8/site-packages/logparser-0.8.2-py3.8.egg/logparser/common.py", line 188, in parse_crawler_stats
    return json.loads(text)
  File "/usr/lib/python3.8/json/__init__.py", line 357, in loads
    return _default_decoder.decode(s)
  File "/usr/lib/python3.8/json/decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/usr/lib/python3.8/json/decoder.py", line 355, in raw_decode
    raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 113 (char 112)