search

InternetHealthReport / internet-yellow-pages

A knowledge graph for Internet resources
GNU General Public License v3.0
39 stars 16 forks source link

Bug/JSONDecoder Error in 'iyp.crawlers.ihr.country_dependency' Module #79

Closed mohamedawnallah closed 9 months ago

mohamedawnallah commented 9 months ago

Describe the bug json.decoder.JSONDecodeError: Expecting ',' delimiter: line 1 column 401815 (char 401814) in iyp.crawlers.ihr.country_dependency module

To Reproduce Please check iyp-2023-12-01.log: https://exp1.iijlab.net/wip/iyp/dumps/2023/12/01/iyp-2023-12-01.log

Screenshots

Screenshot 2023-12-12 at 8 49 03 AM
m-appel commented 9 months ago

Hi, thanks for looking at the logs :) However, we actually do not need issues based on errors from the logs, since we already check them every week. Sometimes crawlers fail due to connectivity errors (like in this case) and just need to be rerun. Romain added a line at the bottom

2023-12-06 00:00 Romain: manually reruned ihr_dependency

so this is already addressed.

But, I will take this opportunity and update the Bug Report issue template to highlight that we don't need reports based on the log.

Thanks

romain-fontugne commented 9 months ago

thank you both :)