herowinb / live-dl

Web GUI for Youtube-dl and Bash Script auto download/record upcoming live stream on Youtube and Twitch.
https://hub.docker.com/r/herowinb/live-dl
GNU Affero General Public License v3.0
29 stars 5 forks source link

Unknown metadata error, unable to record livestream #29

Closed challi1337 closed 4 weeks ago

challi1337 commented 4 weeks ago

Describe the bug When running live-dl it is unable to download the currently ongoing livestream. The yt-dl webserver is able to download the livestream with the link that live-dl extracts from the channel id.

5fa831d4e859:/usr/src/app# live-dl --debug UCnGcBDQPDy_IRc3Ikq9yObA
[Thu Oct  3 08:01:41 UTC 2024] DEBUG: Live-dl is up to date
[Thu Oct  3 08:01:41 UTC 2024] URL (URI) to process           : UCnGcBDQPDy_IRc3Ikq9yObA
[Thu Oct  3 08:01:41 UTC 2024] Mode                           : download  
[Thu Oct  3 08:01:41 UTC 2024] Output base dir                : /youtube-dl/Downloads
[Thu Oct  3 08:01:41 UTC 2024] Separate folder for membership : true
[Thu Oct  3 08:01:41 UTC 2024] Remove Title                   : false
[Thu Oct  3 08:01:41 UTC 2024] Archive chat                   : false - Mode: 
[Thu Oct  3 08:01:41 UTC 2024] Keyword filter                 : false
[Thu Oct  3 08:01:41 UTC 2024] Run interval (when loop)       : 30
[Thu Oct  3 08:01:41 UTC 2024] Long interval (when loop)      : 60
[Thu Oct  3 08:01:41 UTC 2024] Skip embedding metadata        : true
[Thu Oct  3 08:01:41 UTC 2024] Skip email notification        : true
[Thu Oct  3 08:01:41 UTC 2024] Skip Slack notification        : true
[Thu Oct  3 08:01:41 UTC 2024] Skip Telegram notification     : true
[Thu Oct  3 08:01:41 UTC 2024] Skip Discord notification      : true
[Thu Oct  3 08:01:41 UTC 2024] Callback                       : false
[Thu Oct  3 08:01:41 UTC 2024] Address Pool                   : false
[Thu Oct  3 08:01:41 UTC 2024] Email provider                 : ses
[Thu Oct  3 08:01:41 UTC 2024] One-time execution             : false
[Thu Oct  3 08:01:41 UTC 2024] No log mode                    : 
[Thu Oct  3 08:01:41 UTC 2024] URI detected, guessing... (Use full URL to avoid guessing URL)
[Thu Oct  3 08:01:41 UTC 2024] YouTube channel ID detected
[Thu Oct  3 08:01:41 UTC 2024] Checking https://www.youtube.com/channel/UCnGcBDQPDy_IRc3Ikq9yObA/live...
[Thu Oct  3 08:01:41 UTC 2024] DEBUG: start func_check_state
[Thu Oct  3 08:01:41 UTC 2024] DEBUG: Cookies using: ./config/cookies.txt
[Thu Oct  3 08:01:41 UTC 2024] DEBUG: start func_check_newlivestream_ytb
[Thu Oct  3 08:01:42 UTC 2024] DEBUG: Can not detect living stream, checking schedule streams
[Thu Oct  3 08:01:42 UTC 2024] DEBUG: Can not detect scheduled stream which scheduled time less than 2h
[Thu Oct  3 08:01:42 UTC 2024] DEBUG: Got valid cURL metadata
[Thu Oct  3 08:01:42 UTC 2024] DEBUG: Is live: true
[Thu Oct  3 08:01:43 UTC 2024] DEBUG: Playability: LIVE_STREAM_OFFLINE
[Thu Oct  3 08:01:43 UTC 2024] DEBUG: Playability Reason: We're experiencing technical difficulties.
[Thu Oct  3 08:01:43 UTC 2024] DEBUG: Streamability ID: 0UAdMEl6D5w
[Thu Oct  3 08:01:43 UTC 2024] DEBUG: Scheduled Start Time: 
[Thu Oct  3 08:01:43 UTC 2024] DEBUG: Channel: λ²„λ‹ˆ bunniejin
[Thu Oct  3 08:01:43 UTC 2024] DEBUG: Title: from Singapore πŸ‡ΈπŸ‡¬
[Thu Oct  3 08:01:43 UTC 2024] cURL check seems goes live now, continue checking...
[Thu Oct  3 08:01:43 UTC 2024] DEBUG: No keyword filter run, mark as downloadable...
[Thu Oct  3 08:01:43 UTC 2024] DEBUG: Current state for first check: live
[Thu Oct  3 08:01:43 UTC 2024] Re-checking via yt-dlp...
[Thu Oct  3 08:01:43 UTC 2024] Get real video url: https://www.youtube.com/watch?v=0UAdMEl6D5w
[Thu Oct  3 08:01:44 UTC 2024] DEBUG: Got valid yt-dlp metadata
[Thu Oct  3 08:01:44 UTC 2024] DEBUG: ERROR: [youtube] 0UAdMEl6D5w: We're experiencing technical difficulties.
[Thu Oct  3 08:01:44 UTC 2024] Unknown metadata
[Thu Oct  3 08:01:44 UTC 2024] ERROR: [youtube] 0UAdMEl6D5w: We're experiencing technical difficulties.
[Thu Oct  3 08:01:44 UTC 2024] DEBUG: Current state for second check: invalid
[Thu Oct  3 08:01:44 UTC 2024] DEBUG: Found long interval setting 60

using latest version of live-dl on linux debian 12 docker

challi1337 commented 4 weeks ago

changing config to YTARCHIVE seems to have fixed the issue

herowinb commented 4 weeks ago

I tried to run with same channel, it look fine from my end. Also no Youtube issues reported on yt-dlp, so I think it maybe just a Youtube hiccup error.

live-dl UCnGcBDQPDy_IRc3Ikq9yObA --debug
[Thu Oct  3 10:12:44 UTC 2024] DEBUG: Live-dl is up to date
[Thu Oct  3 10:12:44 UTC 2024] URL (URI) to process           : UCnGcBDQPDy_IRc3Ikq9yObA
[Thu Oct  3 10:12:44 UTC 2024] Mode                           : download - Using YTARCHIVE
[Thu Oct  3 10:12:44 UTC 2024] Output base dir                : /youtube-dl/VTuber Recordings
[Thu Oct  3 10:12:44 UTC 2024] Separate folder for membership : true
[Thu Oct  3 10:12:44 UTC 2024] Remove Title                   : false
[Thu Oct  3 10:12:44 UTC 2024] Archive chat                   : false - Mode: simple
[Thu Oct  3 10:12:44 UTC 2024] Keyword filter                 : false
[Thu Oct  3 10:12:44 UTC 2024] Run interval (when loop)       : 30
[Thu Oct  3 10:12:44 UTC 2024] Long interval (when loop)      : 900
[Thu Oct  3 10:12:44 UTC 2024] Skip embedding metadata        : true
[Thu Oct  3 10:12:44 UTC 2024] Skip email notification        : false
[Thu Oct  3 10:12:44 UTC 2024] Skip Slack notification        : true
[Thu Oct  3 10:12:44 UTC 2024] Skip Telegram notification     : false
[Thu Oct  3 10:12:44 UTC 2024] Skip Discord notification      : false
[Thu Oct  3 10:12:44 UTC 2024] Callback                       : false
[Thu Oct  3 10:12:44 UTC 2024] Address Pool                   : false
[Thu Oct  3 10:12:44 UTC 2024] Email provider                 : mailgun
[Thu Oct  3 10:12:44 UTC 2024] One-time execution             : false
[Thu Oct  3 10:12:44 UTC 2024] No log mode                    : false
[Thu Oct  3 10:12:44 UTC 2024] URI detected, guessing... (Use full URL to avoid guessing URL)
[Thu Oct  3 10:12:44 UTC 2024] YouTube channel ID detected
[Thu Oct  3 10:12:44 UTC 2024] Checking https://www.youtube.com/channel/UCnGcBDQPDy_IRc3Ikq9yObA/live...
[Thu Oct  3 10:12:44 UTC 2024] DEBUG: start func_check_state
[Thu Oct  3 10:12:44 UTC 2024] DEBUG: Cookies using: ./config/cookies.txt
[Thu Oct  3 10:12:44 UTC 2024] DEBUG: start func_check_newlivestream_ytb
[Thu Oct  3 10:12:45 UTC 2024] DEBUG: Can not detect living stream, checking schedule streams
[Thu Oct  3 10:12:45 UTC 2024] DEBUG: Can not detect scheduled stream which scheduled time less than 2h
[Thu Oct  3 10:12:46 UTC 2024] DEBUG: Got valid cURL metadata
[Thu Oct  3 10:12:46 UTC 2024] DEBUG: Is live: true
[Thu Oct  3 10:12:46 UTC 2024] DEBUG: Playability: OK
[Thu Oct  3 10:12:46 UTC 2024] DEBUG: Playability Reason:
[Thu Oct  3 10:12:46 UTC 2024] DEBUG: Streamability ID: 3_Wsk1QmDFY
[Thu Oct  3 10:12:46 UTC 2024] DEBUG: Scheduled Start Time:
[Thu Oct  3 10:12:46 UTC 2024] DEBUG: Channel: λ²„λ‹ˆ bunniejin
[Thu Oct  3 10:12:46 UTC 2024] DEBUG: Title: from Singapore πŸ‡ΈπŸ‡¬
[Thu Oct  3 10:12:46 UTC 2024] cURL check seems goes live now, continue checking...
[Thu Oct  3 10:12:46 UTC 2024] DEBUG: No keyword filter run, mark as downloadable...
[Thu Oct  3 10:12:46 UTC 2024] DEBUG: Current state for first check: live
[Thu Oct  3 10:12:46 UTC 2024] Re-checking via yt-dlp...
[Thu Oct  3 10:12:46 UTC 2024] Get real video url: https://www.youtube.com/watch?v=3_Wsk1QmDFY
[Thu Oct  3 10:12:47 UTC 2024] DEBUG: Got valid yt-dlp metadata
[Thu Oct  3 10:12:48 UTC 2024] DEBUG: Channel name mapping not found, consider adding it in config.yml
[Thu Oct  3 10:12:48 UTC 2024] DEBUG: I will use λ²„λ‹ˆ bunniejin for folder name, embedding metadata, etc.
[Thu Oct  3 10:12:48 UTC 2024] DEBUG: Telegram channel not found, consider adding it in config.yml
[Thu Oct  3 10:12:49 UTC 2024] DEBUG: Got state: live
[Thu Oct  3 10:12:49 UTC 2024] DEBUG: Current state for second check: live
[Thu Oct  3 10:12:49 UTC 2024] DEBUG: Found long interval setting 900
[Thu Oct  3 10:12:49 UTC 2024] Prepare downloading...
[Thu Oct  3 10:12:49 UTC 2024] DEBUG: Download platform: YouTube
[Thu Oct  3 10:12:49 UTC 2024] DEBUG: Download type: channel
[Thu Oct  3 10:12:49 UTC 2024] DEBUG: Download mode: download

ID:        3_Wsk1QmDFY
Title:     from Singapore πŸ‡ΈπŸ‡¬
URL:       https://www.youtube.com/watch?v=3_Wsk1QmDFY
Author:    λ²„λ‹ˆ bunniejin
Channel:   https://www.youtube.com/channel/UCnGcBDQPDy_IRc3Ikq9yObA
Date:      20241003
Thumbnail: https://i.ytimg.com/vi/3_Wsk1QmDFY/maxresdefault.jpg
Filename:  20241003 from Singapore πŸ‡ΈπŸ‡¬ (3_Wsk1QmDFY).1
Location:  /youtube-dl/VTuber Recordings/λ²„λ‹ˆ bunniejin/
Hostname:  169862ae69d7

[Thu Oct  3 10:12:49 UTC 2024] Sending email notification...
[Thu Oct  3 10:12:49 UTC 2024] Sending Discord notification...
[Thu Oct  3 10:12:49 UTC 2024] No specific channel set for current user, skip sending Telegram notification.
[Thu Oct  3 10:12:50 UTC 2024] DEBUG: No run archive chat.
[Thu Oct  3 10:12:50 UTC 2024] DEBUG: start func_download_youtube
[Thu Oct  3 10:12:50 UTC 2024] Start downloading 20241003 from Singapore πŸ‡ΈπŸ‡¬ (3_Wsk1QmDFY).1
[Thu Oct  3 10:12:50 UTC 2024] Logging: tail -f "/youtube-dl/VTuber Recordings/λ²„λ‹ˆ bunniejin/20241003 from Singapore πŸ‡Έ
πŸ‡¬ (3_Wsk1QmDFY).1.log"