ZeroQI / Absolute-Series-Scanner

Seasons, absolute mode, Subfolders...
1k stars 155 forks source link

best way to ungroup episodes of a playlist #338

Closed ecto1a2003 closed 3 years ago

ecto1a2003 commented 3 years ago

I'm downloading https://www.youtube.com/playlist?list=PLiSdC6Lp8c7PGwbj9Ed0wYMMrz6ZU3rhQ

everything is showing as duplicate of episode 13 due to the playlist title containing the number 13 thoughts?

ZeroQI commented 3 years ago

@ecto1a2003 Please report and close if resolved. Tested pleinty with your library so should be resolved

ecto1a2003 commented 3 years ago

Massive improvement! doesn't seem like collections are auto generating

still some duplicates, seems to be in same grouping folder but across series, matching on leading number? this is from the bigger library and not the testing one.

image

WoolieVersus.scanner.log

WoolieVersus.scanner.log

WoolieVersus.filelist.log PeachSaliva.filelist.log PeachSaliva.scanner.log root.scanner.log

ZeroQI commented 3 years ago

Just updated the youtube agent in a new branch if you want to test. It only loads posters when needed and have 200 lines less than before same functions

Need Super Best Friend Play.scanner.log and file list.log to reproduce exactly.

ecto1a2003 commented 3 years ago

filelist.txt

doing plexdance , will get log once complete. new agent downloading as well.

ecto1a2003 commented 3 years ago

tentative results from plex dance are promising, itll take a while.

ZeroQI commented 3 years ago

That's the problem with grouping folders, every scan need to go over everything while if the series folder is at the library root, the scan is cached and only redone if the folder content changed, making it faster

Keep me posted but worked hard on ass scanner and youtube agent and worked with no error but youtube kinda slow (had coded on youtube agent for a week with no test to clean structure as it was messy). Keep me posted

ecto1a2003 commented 3 years ago

I'm away from it right now but looks ok. Is there a way to auto generate collections without grouping folders because that's the reason I have them.

ZeroQI commented 3 years ago

I have grouping folders and collections on my test library. Attach HAMA per series logs in agent data folders for a series in a grouping folder with more than one playlist inside...

On Sun, Mar 7, 2021, 00:40 ecto1a2003 notifications@github.com wrote:

I'm away from it right now but looks ok. Is there a way to auto generate collections without grouping folders because that's the reason I have them.

— You are receiving this because you modified the open/close state. Reply to this email directly, view it on GitHub https://github.com/ZeroQI/Absolute-Series-Scanner/issues/338#issuecomment-792132216, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABHMWZKONXSONIGMJEAZNTTTCLDRPANCNFSM4YNT3AOA .

ecto1a2003 commented 3 years ago

WoolieVersus.scanner.log WoolieVersus.filelist.log

heres logs for some duplicates. some episodes have 30+ duplicates.

image

ZeroQI commented 3 years ago

@ecto1a2003 Error reading url 'https://www.googleapis.com/youtube/v3/playlistItems?part=snippet&maxResults=50&playlistId=PLiSdC6Lp8c7PGwbj9Ed0wYMMrz6ZU3rhQ&key=AIzaSyBBTdHNd4fVHNXBp0u9kVWF7NUH1ffLz-g', Exception: 'HTTP Error 403: Forbidden

You are using your own API key? If not, mine is overused. I might remove it from the agent, as it complains by email everytime I submit code changes Need to add a fallback for Playlist access broken or not ? Could use local json file if any to avoid access but would need a copy of one

ZeroQI commented 3 years ago

added support for local playlist file 'Playlist.info.json' created with: youtube-dl.exe -J --dump-single-json https://www.youtube.com/playlist?list=PLiSdC6Lp8c7PGwbj9Ed0wYMMrz6ZU3rhQ > Playlist.info.json

ecto1a2003 commented 3 years ago

My key was full from the re-add, still have the same duplicate issues once the key reset.

ecto1a2003 commented 3 years ago

image multiple duplicates still, and episodes form multiple series now adding to wrong series as well. scanning never finishes as my key fills instantly. should i not use grouping folders so the scanning can cache? collections aren't being generated currently anyway.

ZeroQI commented 3 years ago

Just updated master code and readme, and the agent as well, that should be more stable Please use your own API key, you have a lot of videos seemingly, and create Playlist.info.json, as that will prevent API calls for playlists.

ecto1a2003 commented 3 years ago

I am using my own key, I've decided to move away from grouping folders so it doesn't pull 10k+ videos everyday. can collections be automatedly generated without them?

I have a lot of playlists as well, will i need to create new playlists files as items are added?

ZeroQI commented 3 years ago

You have the biggest library, that's for sure

ecto1a2003 commented 3 years ago

A setting to automatically generate collections from channel/producer would be great! I'm looking at scripting the creation and updating of the playlist.info.json files as new content is added to some of the playlist I monitor.

ecto1a2003 commented 3 years ago

thoughts on this error for youtube-dl and generating the playist.info.json?

ERROR: Private video Sign in if you've been granted access to this video

ZeroQI commented 3 years ago

It seems you need to be logged in and have right to view the video/playlist as it is set to private https://www.reddit.com/r/youtubedl/comments/gsamg0/how_to_download_my_private_videos/

ecto1a2003 commented 3 years ago

bummer,

i made a test library and populated the json files, completely empty again.

root.scanner.log Monster_Factory [PLt5zc-HxINkpAr9Ri_qJtzklB9YK2Eunh].filelist.log Monster_Factory [PLt5zc-HxINkpAr9Ri_qJtzklB9YK2Eunh].scanner.log Plex Media Scanner.log

ecto1a2003 commented 3 years ago

json files are too big to upload here

ecto1a2003 commented 3 years ago

if i remove the playlist json files it starts to show up

ecto1a2003 commented 3 years ago

current code combo is working as far as duplicates. no collections but I'm no longer using grouping folders.