[Bug] Missing hash key: "streamingData" (KeyError)

[mrgrey916]

Got this error this morning, and only for that video, the few others I've played are fine.

Title: Missing hash key: "streamingData" (KeyError) Date: 2024-09-02T09:14:29Z Route: /watch?v=8zmKbaV1vN8 Version: 2024.08.26-4782a67 @ (HEAD detached at v2.20240825.2)

Backtrace

``` Missing hash key: "streamingData" (KeyError) from /usr/share/crystal/src/hash.cr:1151:9 in 'dig' from /usr/share/crystal/src/json/any.cr:261:3 in 'adaptive_fmts' from src/invidious/routes/watch.cr:123:5 in 'handle' from lib/kemal/src/kemal/route.cr:13:9 in '->' from src/invidious/helpers/handlers.cr:30:37 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call_next' from lib/kemal/src/kemal/filter_handler.cr:21:7 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call_next' from src/invidious/helpers/handlers.cr:94:12 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call_next' from src/ext/kemal_static_file_handler.cr:106:14 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call' from /usr/share/crystal/src/http/server/request_processor.cr:51:11 in 'handle_client' from /usr/share/crystal/src/fiber.cr:141:11 in 'run' from ??? ```

[TheTrueWhiteOwl]

Same here! Here is my logs:

Logs

Title: Missing hash key: "streamingData" (KeyError) Date: 2024-09-02T16:54:58Z Route: /watch?v=DQB-cJPYChg Version: 2024.08.25-3e17d048 @ master

Backtrace

``` Missing hash key: "streamingData" (KeyError) from /usr/share/crystal/src/hash.cr:1148:11 in '[]' from /usr/share/crystal/src/hash.cr:1199:17 in 'dig' from src/invidious/videos.cr:156:18 in 'adaptive_fmts' from src/invidious/routes/watch.cr:121:5 in 'handle' from src/invidious/routing.cr:159:19 in '->' from lib/kemal/src/kemal/route.cr:12:26 in '->' from src/invidious/helpers/handlers.cr:30:5 in 'process_request' from lib/kemal/src/kemal/route_handler.cr:17:7 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call_next' from lib/kemal/src/kemal/websocket_handler.cr:13:14 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call_next' from lib/kemal/src/kemal/filter_handler.cr:21:7 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call_next' from src/invidious/helpers/handlers.cr:157:5 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call_next' from src/invidious/helpers/handlers.cr:94:12 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call_next' from src/invidious/helpers/handlers.cr:146:5 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call_next' from src/invidious/helpers/handlers.cr:70:5 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call_next' from src/ext/kemal_static_file_handler.cr:162:16 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call_next' from lib/kemal/src/kemal/exception_handler.cr:8:7 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call_next' from src/invidious/helpers/logger.cr:17:35 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call_next' from lib/kemal/src/kemal/init_handler.cr:12:7 in 'call' from /usr/share/crystal/src/http/server/request_processor.cr:51:11 in 'process' from /usr/share/crystal/src/http/server.cr:521:5 in 'handle_client' from /usr/share/crystal/src/http/server.cr:451:5 in '->' from /usr/share/crystal/src/fiber.cr:143:11 in 'run' from /usr/share/crystal/src/fiber.cr:95:34 in '->' from ??? ```

[Fijxu]

Merging #4850 seems to fix it. I discovered it by accident because I merged that commit into my Invidious fork to use it on my instance (My public instance is not using that commit tho, is sitting at 5ced7694fe).

When I pulled my invidious fork to debug it, it already had the pending pull request (#4850) and the premiere (/watch?v=DQB-cJPYChg) was displayed on Invidious without errors.

[iBicha]

Interesting, I saw a similar error but for missing adaptiveFormats. This is supposed to be a live video, and works on YouTube. Also, the api (/api/v1/videos/6K6N0z93Vj0) returns a 200 status code and an empty response

Title: Missing hash key: "adaptiveFormats" (KeyError) Date: 2024-09-02T22:54:37Z Route: /watch?v=6K6N0z93Vj0 Version: 2024.08.26-4782a67 @ master

Backtrace

``` Missing hash key: "adaptiveFormats" (KeyError) from /usr/share/crystal/src/hash.cr:1151:9 in '??' from /usr/share/crystal/src/json/any.cr:261:3 in 'adaptive_fmts' from src/invidious/routes/watch.cr:123:5 in 'handle' from lib/kemal/src/kemal/route.cr:13:9 in '->' from src/invidious/helpers/handlers.cr:30:37 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call_next' from lib/kemal/src/kemal/filter_handler.cr:21:7 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call_next' from src/invidious/helpers/handlers.cr:94:12 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call_next' from src/ext/kemal_static_file_handler.cr:106:14 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call' from /usr/share/crystal/src/http/server/request_processor.cr:51:11 in 'handle_client' from /usr/share/crystal/src/fiber.cr:141:11 in 'run' from ??? ```

[retrocaster]

I'm seeing the same for the following:

Title: Missing hash key: "streamingData" (KeyError) Date: 2024-09-05T21:45:44Z Route: /watch?v=fobcz96o3PE Version: 2024.08.26-4782a67 @ (HEAD detached at v2.20240825.2)

[iGerman00]

Same issue. This video as of now is a premiere. Previously, premieres returned information okay on Invidious, but now it's a fatal error.

Title: Missing hash key: "streamingData" (KeyError) Date: 2024-09-12T19:01:20Z Route: /watch?v=acdYs9tPLko Version: 2024.08.26-4782a67 @ (HEAD detached at v2.20240825.2)

Backtrace

``` Missing hash key: "streamingData" (KeyError) from src/invidious/helpers/helpers.cr:188 in 'dig' from /usr/lib/crystal/core/json/any.cr:261:3 in 'adaptive_fmts' from src/invidious/routes/watch.cr:123:5 in 'handle' from lib/kemal/src/kemal/route.cr:13:9 in '->' from lib/kemal/src/kemal/config.cr:92:7 in 'call' from /usr/lib/crystal/core/http/server/handler.cr:30:7 in 'call' from /usr/lib/crystal/core/http/server/handler.cr:32:7 in 'call_next' from lib/kemal/src/kemal/filter_handler.cr:21:7 in 'call' from /usr/lib/crystal/core/http/server/handler.cr:30:7 in 'call' from /usr/lib/crystal/core/http/server/handler.cr:32:7 in 'call_next' from src/invidious/helpers/handlers.cr:94:12 in 'call' from /usr/lib/crystal/core/http/server/handler.cr:30:7 in 'call' from /usr/lib/crystal/core/http/server/handler.cr:30:7 in 'call' from /usr/lib/crystal/core/http/server/handler.cr:32:7 in 'call_next' from /usr/lib/crystal/core/string.cr:3075:20 in 'call' from /usr/lib/crystal/core/http/server/handler.cr:30:7 in 'call' from /usr/lib/crystal/core/http/server/handler.cr:30:7 in 'call' from /usr/lib/crystal/core/http/server/handler.cr:30:7 in 'call' from /usr/lib/crystal/core/http/server/request_processor.cr:51:11 in 'handle_client' from /usr/lib/crystal/core/fiber.cr:146:11 in 'run' from ??? ```

[mlazzarotto]

Same Title: Missing hash key: "streamingData" (KeyError) Date: 2024-10-19T15:21:22Z Route: /watch?v=2tF0QcVEcxU Version: 2024.08.26-4782a67 @ (HEAD detached at v2.20240825.2)

Backtrace

``` Missing hash key: "streamingData" (KeyError) from /usr/share/crystal/src/hash.cr:1151:9 in 'dig' from /usr/share/crystal/src/json/any.cr:261:3 in 'adaptive_fmts' from src/invidious/routes/watch.cr:123:5 in 'handle' from lib/kemal/src/kemal/route.cr:13:9 in '->' from src/invidious/helpers/handlers.cr:30:37 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call_next' from lib/kemal/src/kemal/filter_handler.cr:21:7 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call_next' from src/invidious/helpers/handlers.cr:94:12 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call_next' from src/ext/kemal_static_file_handler.cr:106:14 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call' from /usr/share/crystal/src/http/server/handler.cr:30:7 in 'call' from /usr/share/crystal/src/http/server/request_processor.cr:51:11 in 'handle_client' from /usr/share/crystal/src/fiber.cr:141:11 in 'run' from ??? ```