search

alexbelgium / hassio-addons

My homeassistant addons
MIT License
1.46k stars 210 forks source link

🐛 [Changedetection.io] all watches error after update to 0.46.1 #1489

Closed RhysMcW closed 1 month ago

RhysMcW commented 1 month ago

Description

after updating to 0.46.1 all watches error immediately on check with Exception: 'ascii' codec can't decode byte 0xd8 in position 409: ordinal not in range(128) Have restarted Changedetection.io addon multiple times and also Browserless Chromium but not seeing any new entries in the Browserless Chromium log when doing the recheck in Changedetection.io, so seems to be failing in Changedetection.io before even trying to use Browserless

Reproduction steps

1. update to 0.46.1
2. Click on 'recheck' for any watch
3. See error

Addon Logs

Wiki here on how to use : github.com/alexbelgium/hassio-addons/wiki/Add‐ons-feature-:-add-env-variables

FETCH_WORKERS='2'
WEBDRIVER_URL='http://db21ed7f-browserless-chrome.local.hass.io:3000/playwright/chromium'
PLAYWRIGHT_DRIVER_URL='ws://db21ed7f-browserless-chrome.local.hass.io:3000/chromium?launch={defaultViewport:{height:720,width:1280},headless:false,stealth:true}&blockAds=false'
/etc/cont-init.d/01-custom_script.sh: executing
Execute /homeassistant/addons_config/changedetection.io/changedetection.io.sh if existing
Wiki here : github.com/alexbelgium/hassio-addons/wiki/Add-ons-feature-:-customisation
/etc/cont-init.d/21-folders.sh: executing

Starting the upstream container

[migrations] started
[migrations] no migrations found
───────────────────────────────────────

      ██╗     ███████╗██╗ ██████╗
      ██║     ██╔════╝██║██╔═══██╗
      ██║     ███████╗██║██║   ██║
      ██║     ╚════██║██║██║   ██║
      ███████╗███████║██║╚██████╔╝
      ╚══════╝╚══════╝╚═╝ ╚═════╝

   Brought to you by linuxserver.io
───────────────────────────────────────

To support LSIO projects visit:
https://www.linuxserver.io/donate/

───────────────────────────────────────
GID/UID
───────────────────────────────────────

User UID:    0
User GID:    0
───────────────────────────────────────
Linuxserver.io version: 0.46.01-ls120
Build-date: 2024-07-19T12:55:13+00:00
───────────────────────────────────────

[custom-init] No custom files found, skipping...
crond: crond (busybox 1.36.1) started, log level 8
/app/changedetection/changedetectionio/html_tools.py:355: SyntaxWarning: invalid escape sequence '\['
  pattern = '<!\[CDATA\[(\s*(?:.(?<!\]\]>)\s*)*)\]\]>'
/app/changedetection/changedetectionio/html_tools.py:430: SyntaxWarning: invalid escape sequence '\s'
  content = re.sub('<!--\s+-->', '', content)
2024-07-22 15:54:43.909 | INFO     | changedetectionio.flask_app:<module>:88 - System locale default is (None, None)
2024-07-22 15:54:43.920 | INFO     | changedetectionio.store:__init__:48 - Datastore path is '/config/addons_config/changedetection.io/url-watches.json'
2024-07-22 15:54:43.932 | DEBUG    | changedetectionio.content_fetchers:<module>:34 - Using Playwright library as fetcher
2024-07-22 15:54:43.935 | DEBUG    | changedetectionio.model.Watch:history:177 - Reading watch history index for f17e8056-544e-40c6-aea1-4c7fb470cac2
2024-07-22 15:54:43.936 | INFO     | changedetectionio.store:__init__:88 - Watching: f17e8056-544e-40c6-aea1-4c7fb470cac2 https://news.ycombinator.com/
2024-07-22 15:54:43.936 | DEBUG    | changedetectionio.model.Watch:history:177 - Reading watch history index for 1fa86d20-4e1f-490a-8705-e7e96717b4e6
2024-07-22 15:54:43.936 | INFO     | changedetectionio.store:__init__:88 - Watching: 1fa86d20-4e1f-490a-8705-e7e96717b4e6 https://changedetection.io/CHANGELOG.txt
2024-07-22 15:54:43.937 | DEBUG    | changedetectionio.model.Watch:history:177 - Reading watch history index for f6e97e39-47ef-408d-881e-0fead7b72f58
2024-07-22 15:54:43.937 | INFO     | changedetectionio.store:__init__:88 - Watching: f6e97e39-47ef-408d-881e-0fead7b72f58 https://www.ianseo.net/Releases.php
2024-07-22 15:54:43.937 | DEBUG    | changedetectionio.model.Watch:history:177 - Reading watch history index for b00ae79e-3dca-4bc6-a911-6b15d54e43b3
2024-07-22 15:54:43.937 | INFO     | changedetectionio.store:__init__:88 - Watching: b00ae79e-3dca-4bc6-a911-6b15d54e43b3 https://www.worldarchery.sport/rulebook/interpretations
2024-07-22 15:54:43.938 | DEBUG    | changedetectionio.model.Watch:history:177 - Reading watch history index for fa877490-27f0-4ede-b5dc-4b7fcf4a6250
2024-07-22 15:54:43.938 | INFO     | changedetectionio.store:__init__:88 - Watching: fa877490-27f0-4ede-b5dc-4b7fcf4a6250 https://www.worldarchery.sport/rulebook/article/2
2024-07-22 15:54:43.938 | DEBUG    | changedetectionio.model.Watch:history:177 - Reading watch history index for 305007bd-a5b5-4261-ad71-8853a6781539
2024-07-22 15:54:43.939 | INFO     | changedetectionio.store:__init__:88 - Watching: 305007bd-a5b5-4261-ad71-8853a6781539 https://www.nedbank.co.za/content/nedbank/desktop/gt/en/personal/forex/forex-rates.html
2024-07-22 15:54:43.939 | DEBUG    | changedetectionio.model.Watch:history:177 - Reading watch history index for 2a67f11a-be96-40fd-bbd6-1c5364e0b8e0
2024-07-22 15:54:43.939 | INFO     | changedetectionio.store:__init__:88 - Watching: 2a67f11a-be96-40fd-bbd6-1c5364e0b8e0 https://www.nedbank.co.za/content/nedbank/desktop/gt/en/personal/forex/forex-rates.html
2024-07-22 15:54:43.939 | INFO     | changedetectionio.store:__init__:93 - Tag: 88d32f36-e30b-4a2d-b3e4-5cfe83d1d1bf Tech news
2024-07-22 15:54:43.940 | INFO     | changedetectionio.store:__init__:93 - Tag: 8e2b75cc-af85-42a1-a47f-9fae796224e1 changedetection.io
2024-07-22 15:54:43.940 | INFO     | changedetectionio.store:__init__:93 - Tag: c200ce2e-a904-4d16-bc20-3606ecea2b1b Archery
2024-07-22 15:54:43.941 | INFO     | changedetectionio.store:sync_to_json:383 - Saving JSON..
(429) wsgi starting up on http://0.0.0.0:5000
2024-07-22 15:54:43.975 | DEBUG    | changedetectionio.flask_app:ticker_thread_check_time_launch_checks:1762 - System env MINIMUM_SECONDS_RECHECK_TIME 3
(429) accepted ('10.0.254.65', 52352)
10.0.254.65 - - [22/Jul/2024 15:54:44] "POST /form/checkbox-operations HTTP/1.1" 302 687 0.005019
Connection to localhost (127.0.0.1) 5000 port [tcp/*] succeeded!
(429) accepted ('127.0.0.1', 60788)
[ls.io-init] done.
2024-07-22 15:54:44.409 | DEBUG    | changedetectionio.model.Watch:history:177 - Reading watch history index for 305007bd-a5b5-4261-ad71-8853a6781539
2024-07-22 15:54:44.410 | DEBUG    | changedetectionio.model.Watch:history:177 - Reading watch history index for 2a67f11a-be96-40fd-bbd6-1c5364e0b8e0
2024-07-22 15:54:44.411 | DEBUG    | changedetectionio.model.Watch:history:177 - Reading watch history index for f17e8056-544e-40c6-aea1-4c7fb470cac2
10.0.254.65 - - [22/Jul/2024 15:54:44] "GET / HTTP/1.1" 200 9221 0.122427
10.0.254.65 - - [22/Jul/2024 15:54:44] "GET /static/styles/pure-min.css HTTP/1.1" 200 4219 0.003266
(429) accepted ('10.0.254.65', 52354)
(429) accepted ('10.0.254.65', 52353)
(429) accepted ('10.0.254.65', 52355)
10.0.254.65 - - [22/Jul/2024 15:54:44] "GET /static/js/jquery-3.6.0.min.js HTTP/1.1" 200 31400 0.009665
10.0.254.65 - - [22/Jul/2024 15:54:44] "GET /static/styles/styles.css?v=0.46.01 HTTP/1.1" 200 8496 0.004210
10.0.254.65 - - [22/Jul/2024 15:54:44] "GET /static/js/csrf.js HTTP/1.1" 304 338 0.001817
(429) accepted ('10.0.254.65', 52356)
(429) accepted ('10.0.254.65', 52357)
10.0.254.65 - - [22/Jul/2024 15:54:44] "GET /static/js/watch-overview.js HTTP/1.1" 200 1210 0.002325
10.0.254.65 - - [22/Jul/2024 15:54:44] "GET /static/js/toggle-theme.js HTTP/1.1" 200 1144 0.002227
10.0.254.65 - - [22/Jul/2024 15:54:44] "GET /static/js/jquery-3.6.0.min.js HTTP/1.1" 200 31400 0.009505
10.0.254.65 - - [22/Jul/2024 15:54:44] "GET /static/images/Google-Chrome-icon.png HTTP/1.1" 200 14886 0.001813
10.0.254.65 - - [22/Jul/2024 15:54:44] "GET /static/images/spread-white.svg HTTP/1.1" 200 1269 0.002382
10.0.254.65 - - [22/Jul/2024 15:54:44] "GET /static/images/pause.svg HTTP/1.1" 200 3297 0.001981
10.0.254.65 - - [22/Jul/2024 15:54:44] "GET /static/images/bell-off.svg HTTP/1.1" 200 1633 0.001857
10.0.254.65 - - [22/Jul/2024 15:54:44] "GET /static/images/spread.svg HTTP/1.1" 304 340 0.001858
10.0.254.65 - - [22/Jul/2024 15:54:44] "GET /static/images/steps.svg HTTP/1.1" 304 341 0.001755
10.0.254.65 - - [22/Jul/2024 15:54:44] "GET /static/images/play.svg HTTP/1.1" 304 340 0.001767
10.0.254.65 - - [22/Jul/2024 15:54:44] "GET /static/images/Generic_Feed-icon.svg HTTP/1.1" 304 351 0.001756
10.0.254.65 - - [22/Jul/2024 15:54:44] "GET /static/favicons/apple-touch-icon.png HTTP/1.1" 200 32336 0.002104
10.0.254.65 - - [22/Jul/2024 15:54:44] "GET /static/favicons/favicon-16x16.png HTTP/1.1" 200 13314 0.001790
10.0.254.65 - - [22/Jul/2024 15:55:25] "GET /api/checknow?uuid=f6e97e39-47ef-408d-881e-0fead7b72f58 HTTP/1.1" 302 655 0.003668
2024-07-22 15:55:25.955 | DEBUG    | changedetectionio.model.Watch:history:177 - Reading watch history index for 305007bd-a5b5-4261-ad71-8853a6781539
2024-07-22 15:55:25.958 | DEBUG    | changedetectionio.model.Watch:history:177 - Reading watch history index for 2a67f11a-be96-40fd-bbd6-1c5364e0b8e0
2024-07-22 15:55:25.961 | DEBUG    | changedetectionio.model.Watch:history:177 - Reading watch history index for f17e8056-544e-40c6-aea1-4c7fb470cac2
10.0.254.65 - - [22/Jul/2024 15:55:25] "GET / HTTP/1.1" 200 9248 0.021690
2024-07-22 15:55:25.986 | INFO     | changedetectionio.update_worker:run:256 - Processing watch UUID f6e97e39-47ef-408d-881e-0fead7b72f58 Priority 1 URL https://www.ianseo.net/Releases.php
2024-07-22 15:55:25.989 | ERROR    | changedetectionio.update_worker:run:478 - Exception reached processing watch UUID: f6e97e39-47ef-408d-881e-0fead7b72f58
2024-07-22 15:55:25.990 | ERROR    | changedetectionio.update_worker:run:479 - 'ascii' codec can't decode byte 0xd8 in position 409: ordinal not in range(128)
2024-07-22 15:55:25.990 | DEBUG    | changedetectionio.update_worker:run:577 - Watch f6e97e39-47ef-408d-881e-0fead7b72f58 done in 0.00s
10.0.254.65 - - [22/Jul/2024 15:55:26] "GET /static/styles/styles.css?v=0.46.01 HTTP/1.1" 200 8496 0.006217
10.0.254.65 - - [22/Jul/2024 15:55:26] "GET /static/styles/pure-min.css HTTP/1.1" 200 4219 0.004175
(429) accepted ('10.0.254.65', 52367)
(429) accepted ('10.0.254.65', 52368)
10.0.254.65 - - [22/Jul/2024 15:55:26] "GET /static/js/jquery-3.6.0.min.js HTTP/1.1" 200 31400 0.013109
10.0.254.65 - - [22/Jul/2024 15:55:26] "GET /static/js/csrf.js HTTP/1.1" 304 338 0.001811
10.0.254.65 - - [22/Jul/2024 15:55:26] "GET /static/js/watch-overview.js HTTP/1.1" 200 1210 0.002057
10.0.254.65 - - [22/Jul/2024 15:55:26] "GET /static/js/toggle-theme.js HTTP/1.1" 200 1144 0.001808
10.0.254.65 - - [22/Jul/2024 15:55:26] "GET /static/images/Google-Chrome-icon.png HTTP/1.1" 304 355 0.001610
10.0.254.65 - - [22/Jul/2024 15:55:26] "GET /static/js/jquery-3.6.0.min.js HTTP/1.1" 200 31400 0.007126
10.0.254.65 - - [22/Jul/2024 15:55:26] "GET /static/images/pause.svg HTTP/1.1" 304 341 0.002230
10.0.254.65 - - [22/Jul/2024 15:55:26] "GET /static/images/spread-white.svg HTTP/1.1" 304 347 0.002414
10.0.254.65 - - [22/Jul/2024 15:55:26] "GET /static/images/play.svg HTTP/1.1" 304 340 0.002310
10.0.254.65 - - [22/Jul/2024 15:55:26] "GET /static/images/steps.svg HTTP/1.1" 304 341 0.002561
10.0.254.65 - - [22/Jul/2024 15:55:26] "GET /static/images/bell-off.svg HTTP/1.1" 304 343 0.002359
10.0.254.65 - - [22/Jul/2024 15:55:26] "GET /static/images/spread.svg HTTP/1.1" 304 340 0.002272
10.0.254.65 - - [22/Jul/2024 15:55:26] "GET /static/images/Generic_Feed-icon.svg HTTP/1.1" 304 351 0.002259

Architecture

aarch64

OS

HAos

RhysMcW commented 1 month ago

this occurs using "Basic fast Plaintext/HTTP Client" or the Browserless link

RhysMcW commented 1 month ago

have restored back to v0.45.26 and watches look to be working again

igorsantos07 commented 1 month ago

An extra setting added directly to config.yaml solves the issue: https://github.com/dgtlmoon/changedetection.io/discussions/2514

I'm not sure if this should be incorporated in the official add-on config options, or into the default config.yaml, or wait for a fix on upstream.

alexbelgium commented 1 month ago

Thanks! Added

igorsantos07 commented 1 month ago

fastest maintainer ever!!! haahha

RhysMcW commented 1 month ago

An extra setting added directly to config.yaml solves the issue: dgtlmoon/changedetection.io#2514

I'm not sure if this should be incorporated in the official add-on config options, or into the default config.yaml, or wait for a fix on upstream.

thanks, added that to my local HA config.yaml and re-updated - all working

github-actions[bot] commented 1 month ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.