100 Episode maximum with youtube

garbled1 commented 4 years ago

I have a few youtube channels downloaded, some of which have over 100 videos. Recently, 2 of my series suddenly got locked to a 100 episode maximum in Plex. 2 others still show >100, but these two show only 100. I've tried the plex dance, renaming, everything, but nothing makes it pick up the rest.

I tried looking at the filelist and scanner log, but they are old, like a few months ago, and nothing I do in plex causes them to be updated. What causes these to get re-run?

I'm completely stumped, how do I fix this?

ZeroQI commented 4 years ago

Do you see 100 eps in plex only? Can you pass custom ASS filelist and logs in logs folder?

garbled1 commented 4 years ago

So, I took one channel, "Door Monster", and looked online, 517 Eps. My dir has about 1100 files in it, which is about right, give or take.

The ASS logs show:

===
Library: 'no valid X-Plex-Token.id', root: '/var/lib/plexmediaserver/alcyone/
video/Misc/Youtube', path: 'Door Monster-[UU-to_wlckb-bFDtQfUZL3Kw]', files: 
'537', dirs: '0'
Plex scan start: 2020-07-19 15:44:40,538215
=============================================================================
=============================================================================
===
Forced ID (series folder) - source: "youtube", id: "UU-to_wlckb-bFDtQfUZL3Kw"
-----------------------------------------------------------------------------

API_KEY: 'X'
[ 0] https://www.googleapis.com/youtube/v3/playlistItems?part=snippet&maxResu
lts=50&playlistId=UU-to_wlckb-bFDtQfUZL3Kw&key=
fbKwsF_o0
[ 1] https://www.googleapis.com/youtube/v3/playlistItems?part=snippet&maxResu
lts=50&playlistId=UU-to_wlckb-bFDtQfUZL3Kw&key=
fbKwsF_o0&pageToken=CDIQAA
[ 2] https://www.googleapis.com/youtube/v3/playlistItems?part=snippet&maxResu
lts=50&playlistId=UU-to_wlckb-bFDtQfUZL3Kw&key=
fbKwsF_o0&pageToken=CGQQAA
[ 3] https://www.googleapis.com/youtube/v3/playlistItems?part=snippet&maxResu
lts=50&playlistId=UU-to_wlckb-bFDtQfUZL3Kw&key=
fbKwsF_o0&pageToken=CJYBEAA
[ 4] https://www.googleapis.com/youtube/v3/playlistItems?part=snippet&maxResu
lts=50&playlistId=UU-to_wlckb-bFDtQfUZL3Kw&key=
fbKwsF_o0&pageToken=CMgBEAA
[ 5] https://www.googleapis.com/youtube/v3/playlistItems?part=snippet&maxResu
lts=50&playlistId=UU-to_wlckb-bFDtQfUZL3Kw&key=
fbKwsF_o0&pageToken=CPoBEAA
[ 6] https://www.googleapis.com/youtube/v3/playlistItems?part=snippet&maxResu
lts=50&playlistId=UU-to_wlckb-bFDtQfUZL3Kw&key=
fbKwsF_o0&pageToken=CKwCEAA
[ 7] https://www.googleapis.com/youtube/v3/playlistItems?part=snippet&maxResu
lts=50&playlistId=UU-to_wlckb-bFDtQfUZL3Kw&key=
fbKwsF_o0&pageToken=CN4CEAA
[ 8] https://www.googleapis.com/youtube/v3/playlistItems?part=snippet&maxResu
lts=50&playlistId=UU-to_wlckb-bFDtQfUZL3Kw&key=
fbKwsF_o0&pageToken=CJADEAA
[ 9] https://www.googleapis.com/youtube/v3/playlistItems?part=snippet&maxResu
lts=50&playlistId=UU-to_wlckb-bFDtQfUZL3Kw&key=
fbKwsF_o0&pageToken=CMIDEAA
[10] https://www.googleapis.com/youtube/v3/playlistItems?part=snippet&maxResu
lts=50&playlistId=UU-to_wlckb-bFDtQfUZL3Kw&key=
fbKwsF_o0&pageToken=CPQDEAA
---- count: 100
None of video IDs found in filename: Before and After - Mayor VS Mayor (Green
 Screen) [5_8_9eNwD6o].mkv
None of video IDs found in filename: LOOK AT THAT NUMBER - $50,000 [lFrbQH8TQ
3o].mkv
None of video IDs found in filename: Blob Battles #1 [BueiYnSO5fA].mp4
[Bdgv5ccX8wg] rank:  20 in file: Making_the_Most_of_Jump_in_5E_There_s_Rules_
For_That [Bdgv5ccX8wg].mkv
"Door Monster-[UU-to_wlckb-bFDtQfUZL3Kw]" s01e020                         "Yo
uTube" "Making the Most of Jump in 5E | There's Rules For That" "Making_the_M
ost_of_Jump_in_5E_There_s_Rules_For_That [Bdgv5ccX8wg].mkv"

Do I just happen to have 2 libraries with exactly 100 videos with a different ID style that is throwing off the scanner?

ZeroQI commented 4 years ago

Door Monster

Playlist: PL0u5ZHidq4X48xzpr-IfP8nHVFhtQfitZ (exemple)
Channel: UC-to_wlckb-bFDtQfUZL3Kw

You did not paste the filelist nor logs fully so it is tricky to assess the situation However, it seems you changed the second letter of the channel from a C to a U.

Why did you not name the folder "Door Monster [UC-to_wlckb-bFDtQfUZL3Kw]" but 'Door Monster-[UU-to_wlckb-bFDtQfUZL3Kw]'? i tested the channel with UCxxx doesn't exist and it's not a playlist so...

garbled1 commented 4 years ago

I'm not sure where you got the UC part, but my directory is definitely UU.. however.. a quick look at my log shows something interesting.. A week or two ago, I was showing 525 videos (in plex), and now I show 100.

Scanner Logs# grep -c 'None of video IDs found in filename' Door\ Monster-[UU-to_wlckb-bFDtQfUZL3Kw].scanner.log 425

So suddenly, it doesn't like some of my video ID's, namely 425 of them...

"Door Monster-[UU-to_wlckb-bFDtQfUZL3Kw]" s01e021                         "Yo
uTube" "The Great Goblin Heist | Guest Quest" "The_Great_Goblin_Heist_Guest_Q
uest [EBX47ck0dcc].f251.webm"
[_ioEQ6cZZlc] rank:  29 in file: A Dungeon and a Dragon _ Guest Quest [_ioEQ6
cZZlc].mkv
"Door Monster-[UU-to_wlckb-bFDtQfUZL3Kw]" s01e029                         "Yo
uTube" "A Dungeon and a Dragon | Guest Quest" "A Dungeon and a Dragon _ Guest
 Quest [_ioEQ6cZZlc].mkv"
None of video IDs found in filename: Why the World Doesn't Suck - White Noise
 {a podcast} [qRa6EgzxuGE].mp4
None of video IDs found in filename: Runaway Smith Bloopers [JUGh2gvw05Q].mkv
None of video IDs found in filename: Community Comments #84 (November 3, 2017
) [Bbt041cdqlI].mkv
None of video IDs found in filename: Community Comments #5 (December 19, 2014
) [SDuRGhoDQ0Q].mkv
None of video IDs found in filename: White Lightning HQ - The Album [tRABobzx
GgQ].webm
[2g__91O5Zrs] rank:  67 in file: Community_Comments_112_April_5_2019 [2g__91O
5Zrs].webm
"Door Monster-[UU-to_wlckb-bFDtQfUZL3Kw]" s01e067                         "Yo
uTube" "Community Comments #112 (April 5, 2019)" "Community_Comments_112_Apri
l_5_2019 [2g__91O5Zrs].webm"

I hunted down one of the specific videos in question on youtube: https://www.youtube.com/watch?v=JUGh2gvw05Q Which matches: None of video IDs found in filename: Runaway Smith Bloopers [JUGh2gvw05Q].mkv

So.. it appears this happened 425 times?

Unless there is some odd 100 item limit on the API key?

ZeroQI commented 4 years ago

In the path of the logs you passed it show UU-to_...

=== Library: 'no valid X-Plex-Token.id', root: '/var/lib/plexmediaserver/alcyone/ video/Misc/Youtube', path: 'Door Monster-[UU-to_wlckb-bFDtQfUZL3Kw]',

I searched on YouTube and the channel is definitely https://m.youtube.com/channel/UC-to_wlckb-bFDtQfUZL3Kw

When searching Google with double quotes "UU-to_wlckb-bFDtQfUZL3Kw" I found nothing.

Please explain where you got it from... https://stackoverflow.com/questions/19795987/youtube-channel-and-playlist-id-prefixes

I'd is channel or playlist. Did you use a favorite video is and expect the agent to find it ??? UC or PL for the ID...

garbled1 commented 4 years ago

Ok yeah. thats odd... apparently I have a playlist, from my youtube-dl logs:

[youtube:playlist] UU-to_wlckb-bFDtQfUZL3Kw: Downloading webpage
[download] Downloading playlist: Uploads from Door Monster
[youtube:playlist] UU-to_wlckb-bFDtQfUZL3Kw: Downloading page #1
[youtube:playlist] UU-to_wlckb-bFDtQfUZL3Kw: Downloading page #2
[youtube:playlist] UU-to_wlckb-bFDtQfUZL3Kw: Downloading page #3
[youtube:playlist] UU-to_wlckb-bFDtQfUZL3Kw: Downloading page #4
[youtube:playlist] UU-to_wlckb-bFDtQfUZL3Kw: Downloading page #5
[youtube:playlist] playlist Uploads from Door Monster: Downloading 517 videos
[download] Downloading video 1 of 517
[download] Gateway Editions | Natural 1 - A D&D Series has already been recorded in archive
[download] Downloading video 2 of 517
[download] Community Comments #116 (July 10, 2020) has already been recorded in archive
...

https://www.youtube.com/playlist?list=UU-to_wlckb-bFDtQfUZL3Kw&playnext=1&index=1

Renaming the dir to UC and now plex sees them all, but apparently UU is in some way a valid playlist, because youtube-dl can download it. Also, that link above works.. It's the "Play All" from the videos page.

The second one that is giving me trouble is also a playlist..

youtube:playlist] UUo9L06Ipw6-Mmkhxr9ORpAQ: Downloading webpage
[download] Downloading playlist: Uploads from Jen Hilman
[youtube:playlist] UUo9L06Ipw6-Mmkhxr9ORpAQ: Downloading page #1
[youtube:playlist] playlist Uploads from Jen Hilman: Downloading 116 videos
[download] Downloading video 1 of 116
[download] Architecture of Asana #3, part 3 - Finding Freedom In Movement - Yoga Flow with Jen Hilman has already been recorded in archive

ZeroQI commented 4 years ago

UU is a personal playlist which is not supported Playlist ID start with PL Channel ID start with UC

If you go to a playlist in YouTube and replace the is with UU... It doesn't work...

Working as designed, closing this ticket. Please consider donating

ZeroQI / Absolute-Series-Scanner

100 Episode maximum with youtube #295