search

iv-org / invidious

Invidious is an alternative front-end to YouTube
https://invidious.io
GNU Affero General Public License v3.0
16.39k stars 1.83k forks source link

[Bug] RefreshChannelsJob: some channel id: Deleted or invalid channel #2284

Closed 89Q12 closed 3 years ago

89Q12 commented 3 years ago

Describe the bug On my instance invidiou.xamh.de I get this error: Deleted or invalid channel each time the RefreshChannelsJob runs or I click subscribe. The problem seems to be in channels.cr:184 but the odd thing is I can't reproduce it locally or other instances. This behaviour started around 02:00 pm UTC way after my pr to add my instance to the instance list was merged.

This happens with the follwing channels: UCksq7I8QduPMyaLkIhsAz8w UCCqnN6ApN4VO9uKOpCoDxww UCAL3JXZSzSm8AlZyD3nQdBA and basically with any other channel that someone subscribed to on my instance

What I tried I already reinstalled invidious but not the database as I dont have a backup new enough with the new users. So I think this has either something to do with the ip of my vps being blocked, but this makes not so much sense because I can see all channel videio when I visit any of the channels. Or there something wrong with the database. At this point I don't know what else to do, thats why I'm opening the issue even tho it seems to be no general issue

Logs

Backtrace: ``` invidious_1 | Exception: Deleted or invalid channel (InfoException) invidious_1 | from src/invidious/channels/channels.cr:186:5 in 'fetch_channel' invidious_1 | from src/invidious/channels/channels.cr:175:1 in 'fetch_channel:pull_all_videos' invidious_1 | from src/invidious/channels/channels.cr:165:15 in 'get_channel' invidious_1 | from src/invidious.cr:546:7 in '->' invidious_1 | from /usr/share/crystal/src/primitives.cr:255:3 in '->' invidious_1 | from /usr/share/crystal/src/primitives.cr:255:3 in 'process_request' invidious_1 | from lib/kemal/src/kemal/route_handler.cr:17:7 in 'call' invidious_1 | from /usr/share/crystal/src/http/server/handler.cr:28:7 in 'call_next' invidious_1 | from lib/kemal/src/kemal/websocket_handler.cr:13:14 in 'call' invidious_1 | from /usr/share/crystal/src/http/server/handler.cr:28:7 in 'call_next' invidious_1 | from lib/kemal/src/kemal/filter_handler.cr:21:7 in 'call' invidious_1 | from /usr/share/crystal/src/http/server/handler.cr:28:7 in 'call_next' invidious_1 | from src/invidious/helpers/handlers.cr:212:5 in 'call' invidious_1 | from /usr/share/crystal/src/http/server/handler.cr:28:7 in 'call_next' invidious_1 | from src/invidious/helpers/handlers.cr:94:12 in 'call' invidious_1 | from /usr/share/crystal/src/http/server/handler.cr:28:7 in 'call_next' invidious_1 | from src/invidious/helpers/handlers.cr:145:12 in 'call' invidious_1 | from /usr/share/crystal/src/http/server/handler.cr:28:7 in 'call_next' invidious_1 | from src/invidious/helpers/handlers.cr:70:5 in 'call' invidious_1 | from /usr/share/crystal/src/http/server/handler.cr:28:7 in 'call_next' invidious_1 | from src/invidious/helpers/static_file_handler.cr:112:11 in 'call' invidious_1 | from /usr/share/crystal/src/http/server/handler.cr:28:7 in 'call_next' invidious_1 | from lib/kemal/src/kemal/exception_handler.cr:8:7 in 'call' invidious_1 | from /usr/share/crystal/src/http/server/handler.cr:28:7 in 'call_next' invidious_1 | from src/invidious/helpers/logger.cr:17:35 in 'call' invidious_1 | from /usr/share/crystal/src/http/server/handler.cr:28:7 in 'call_next' invidious_1 | from lib/kemal/src/kemal/init_handler.cr:12:7 in 'call' invidious_1 | from /usr/share/crystal/src/http/server/request_processor.cr:51:11 in 'process' invidious_1 | from /usr/share/crystal/src/http/server.cr:513:5 in 'handle_client' invidious_1 | from /usr/share/crystal/src/http/server.cr:468:13 in '->' invidious_1 | from /usr/share/crystal/src/primitives.cr:255:3 in 'run' invidious_1 | from /usr/share/crystal/src/fiber.cr:92:34 in '->' invidious_1 | from ??? ```
Additional logs: ``` invidious_1 | 2021-07-27 18:02:27 UTC [trace] RefreshChannelsJob: UCGsoG3Co7MUjLJ9AYaXbNkw fiber : Fetching channel invidious_1 | 2021-07-27 18:02:27 UTC [debug] fetch_channel: UCGsoG3Co7MUjLJ9AYaXbNkw invidious_1 | 2021-07-27 18:02:27 UTC [trace] fetch_channel: UCGsoG3Co7MUjLJ9AYaXbNkw : pull_all_videos = true, locale = invidious_1 | 2021-07-27 18:02:27 UTC [trace] fetch_channel: UCGsoG3Co7MUjLJ9AYaXbNkw : Downloading RSS feed invidious_1 | 2021-07-27 18:02:28 UTC [trace] fetch_channel: UCGsoG3Co7MUjLJ9AYaXbNkw : Parsing RSS feed invidious_1 | 2021-07-27 18:02:28 UTC [error] RefreshChannelsJob: UCGsoG3Co7MUjLJ9AYaXbNkw : Deleted or invalid channel invidious_1 | 2021-07-27 18:02:28 UTC [debug] RefreshChannelsJob: UCGsoG3Co7MUjLJ9AYaXbNkw fiber : Done invidious_1 | 2021-07-27 18:02:28 UTC [trace] RefreshChannelsJob: Fiber limit ok, continuing invidious_1 | 2021-07-27 18:02:28 UTC [debug] RefreshChannelsJob: UCAL3JXZSzSm8AlZyD3nQdBA : Spawning fiber invidious_1 | 2021-07-27 18:02:28 UTC [trace] RefreshChannelsJob: Fiber limit reached, waiting... invidious_1 | 2021-07-27 18:02:28 UTC [trace] RefreshChannelsJob: UCAL3JXZSzSm8AlZyD3nQdBA fiber : Fetching channel invidious_1 | 2021-07-27 18:02:28 UTC [debug] fetch_channel: UCAL3JXZSzSm8AlZyD3nQdBA invidious_1 | 2021-07-27 18:02:28 UTC [trace] fetch_channel: UCAL3JXZSzSm8AlZyD3nQdBA : pull_all_videos = true, locale = invidious_1 | 2021-07-27 18:02:28 UTC [trace] fetch_channel: UCAL3JXZSzSm8AlZyD3nQdBA : Downloading RSS feed invidious_1 | 2021-07-27 18:02:28 UTC [trace] fetch_channel: UCAL3JXZSzSm8AlZyD3nQdBA : Parsing RSS feed invidious_1 | 2021-07-27 18:02:28 UTC [error] RefreshChannelsJob: UCAL3JXZSzSm8AlZyD3nQdBA : Deleted or invalid channel invidious_1 | 2021-07-27 18:02:28 UTC [debug] RefreshChannelsJob: UCAL3JXZSzSm8AlZyD3nQdBA fiber : Done invidious_1 | 2021-07-27 18:02:28 UTC [trace] RefreshChannelsJob: Fiber limit ok, continuing invidious_1 | 2021-07-27 18:02:28 UTC [debug] RefreshChannelsJob: UCSpFnDQr88xCZ80N-X7t0nQ : Spawning fiber invidious_1 | 2021-07-27 18:02:28 UTC [trace] RefreshChannelsJob: Fiber limit reached, waiting... ```
My config: My config: ``` https_only: true domain: invidio.xamh.de external_port: 443 channel_threads: 6 feed_threads: 1 check_tables: true full_refresh: true https_only: true domain: invidio.xamh.de # For debug only log_level: All statistics_enabled: true external_port: 443 ```

Additional context

unixfox commented 3 years ago

Did you setup an anticaptcha system on invidious?

89Q12 commented 3 years ago

No I didn’t, could captchas be the reason for that behavior ?

unixfox commented 3 years ago

No I didn’t, could captchas be the reason for that behavior ?

Probably, every public instances have anticaptcha enabled due to the very likely possibility of generating way more traffic than usual.

89Q12 commented 3 years ago

Probably, every public instances have anticaptcha enabled due to the very likely possibility of generating way more traffic than usual.

Okay, I setup anticaptcha and it works again, thanks for pointing that out :)