RandomNinjaAtk / docker-sonarr-extended

Sonarr (develop) with bash scripts to automate and extend functionality.
GNU General Public License v3.0
66 stars 15 forks source link

Youtube-Series-Downloader - No Download URL found #21

Closed itsgiff closed 1 year ago

itsgiff commented 1 year ago

Youtube-Series-Downloader is finding Series but is struggling to find url.

Good Example of use case for Playlist:

Late Night With Seth Meyers: Corrections https://www.youtube.com/playlist?list=PLJaq64dKJZopIwlqdjPra6a0sHoh_tlVZ ^^ actually specific Web only episodes of Late Night With Seth Meyers but has a specific title.

Same with Disconnected: https://youtube.com/playlist?list=PLCqGc7uWCn7vBlMuMYDn8Nk8CaV130U_X

Log:

Youtube-Series-Downloader.txt

2023-02-05 05:54:37 :: Youtube Series Downloader :: 1.0.0 :: Cookies File Not Found!
2023-02-05 05:54:49 :: Youtube Series Downloader :: 1.0.0 :: 2/3 :: 1/4 :: Disconnected :: S1E1 :: ERROR :: No Download URL found, skipping
2023-02-05 05:54:50 :: Youtube Series Downloader :: 1.0.0 :: 2/3 :: 2/4 :: Disconnected :: S1E2 :: ERROR :: No Download URL found, skipping
2023-02-05 05:54:50 :: Youtube Series Downloader :: 1.0.0 :: 2/3 :: 3/4 :: Disconnected :: S1E3 :: ERROR :: No Download URL found, skipping
2023-02-05 05:54:50 :: Youtube Series Downloader :: 1.0.0 :: 2/3 :: 4/4 :: Disconnected :: S1E4 :: ERROR :: No Download URL found, skipping
2023-02-05 05:54:51 :: Youtube Series Downloader :: 1.0.0 :: 3/3 :: 1/71 :: Late Night With Seth Meyers: Corrections :: S1E1 :: ERROR :: No Download URL found, skipping
2023-02-05 05:54:52 :: Youtube Series Downloader :: 1.0.0 :: 3/3 :: 2/71 :: Late Night With Seth Meyers: Corrections :: S1E2 :: ERROR :: No Download URL found, skipping
2023-02-05 05:54:52 :: Youtube Series Downloader :: 1.0.0 :: 3/3 :: 3/71 :: Late Night With Seth Meyers: Corrections :: S1E3 :: ERROR :: No Download URL found, skipping
2023-02-05 05:54:53 :: Youtube Series Downloader :: 1.0.0 :: 3/3 :: 4/71 :: Late Night With Seth Meyers: Corrections :: S1E4 :: ERROR :: No Download URL found, skipping
2023-02-05 05:54:53 :: Youtube Series Downloader :: 1.0.0 :: 3/3 :: 5/71 :: Late Night With Seth Meyers: Corrections :: S1E5 :: ERROR :: No Download URL found, skipping
2023-02-05 05:54:54 :: Youtube Series Downloader :: 1.0.0 :: 3/3 :: 6/71 :: Late Night With Seth Meyers: Corrections :: S1E6 :: ERROR :: No Download URL found, skipping
2023-02-05 05:54:54 :: Youtube Series Downloader :: 1.0.0 :: 3/3 :: 7/71 :: Late Night With Seth Meyers: Corrections :: S1E7 :: ERROR :: No Download URL found, skipping
[Youtube-Series-Downloader.txt](https://github.com/RandomNinjaAtk/docker-sonarr-extended/files/10611095/Youtube-Series-Downloader.txt)

2023-02-05 05:54:55 :: Youtube Series Downloader :: 1.0.0 :: 3/3 :: 8/71 :: Late Night With Seth Meyers: Corrections :: S1E8 :: ERROR :: No Download URL found, skipping
2023-02-05 05:54:55 :: Youtube Series Downloader :: 1.0.0 :: 3/3 :: 9/71 :: Late Night With Seth Meyers: Corrections :: S1E9 :: ERROR :: No Download URL found, skipping
2023-02-05 05:54:56 :: Youtube Series Downloader :: 1.0.0 :: 3/3 :: 10/71 :: Late Night With Seth Meyers: Corrections :: S1E10 :: ERROR :: No Download URL found, skipping
2023-02-05 05:54:56 :: Youtube Series Downloader :: 1.0.0 :: 3/3 :: 11/71 :: Late Night With Seth Meyers: Corrections :: S1E11 :: ERROR :: No Download URL found, skipping
2023-02-05 05:54:57 :: Youtube Series Downloader :: 1.0.0 :: 3/3 :: 12/71 :: Late Night With Seth Meyers: Corrections :: S1E12 :: ERROR :: No Download URL found, skipping
2023-02-05 05:54:57 :: Youtube Series Downloader :: 1.0.0 :: 3/3 :: 13/71 :: Late Night With Seth Meyers: Corrections :: S1E13 :: ERROR :: No Download URL found, skipping
2023-02-05 05:54:58 :: Youtube Series Downloader :: 1.0.0 :: 3/3 :: 14/71 :: Late Night With Seth Meyers: Corrections :: S1E14 :: ERROR :: No Download URL found, skipping
2023-02-05 05:54:58 :: Youtube Series Downloader :: 1.0.0 :: 3/3 :: 15/71 :: Late Night With Seth Meyers: Corrections :: S1E15 :: ERROR :: No Download URL found, skipping
2023-02-05 05:54:58 :: Youtube Series Downloader :: 1.0.0 :: 3/3 :: 16/71 :: Late Night With Seth Meyers: Corrections :: S1E16 :: ERROR :: No Download URL found, skipping
2023-02-05 05:54:59 :: Youtube Series Downloader :: 1.0.0 :: 3/3 :: 17/71 :: Late Night With Seth Meyers: Corrections :: S1E17 :: ERROR :: No Download URL found, skipping
2023-02-05 05:54:59 :: Youtube Series Downloader :: 1.0.0 :: 3/3 :: 18/71 :: Late Night With Seth Meyers: Corrections :: S1E18 :: ERROR :: No Download URL found, skipping
2023-02-05 05:55:00 :: Youtube Series Downloader :: 1.0.0 :: 3/3 :: 19/71 :: Late Night With Seth Meyers: Corrections :: S1E19 :: ERROR :: No Download URL found, skipping

Youtube-Series-Downloader.txt

itsgiff commented 1 year ago

Update:

All of a sudden it started working with S2E22

Youtube-Series-Downloader.txt

2023-02-05 05:55:10 :: Youtube Series Downloader :: 1.0.0 :: 3/3 :: 41/71 :: Late Night With Seth Meyers: Corrections :: S2E22 :: Downloading via yt-dlp (bestvideo*+bestaudio/best)...
[youtube] qRBP_3HYZZI: Downloading webpage
[youtube] qRBP_3HYZZI: Downloading android player API JSON
[info] qRBP_3HYZZI: Downloading 1 format(s): 248+251
[download] Destination: /config/temp/Late.Night.With.Seth.Meyers:.Corrections.S2E22.WEB-DL-SonarrExtended.f248.webm

image

RandomNinjaAtk commented 1 year ago

It requires TVDB to have the link for the episode. So if you view any series and the episode, if there isn't a URL to the youtube video it won't pull it...

There is no guesswork with this method...

Example: Episode with URL: https://thetvdb.com/series/the-slow-mo-guys/episodes/9567241 Episode without URL: https://thetvdb.com/series/the-slow-mo-guys/episodes/8321489

However, I did notice on the site without the URL, it had a production code that would be the link needed. So I'll see if I can tweak it to use that....

RandomNinjaAtk commented 1 year ago

The latest 1.0.2 can also use the production codes, so a slight improvement...

itsgiff commented 1 year ago

great thank you - will give it a go.

RandomNinjaAtk commented 1 year ago

@itsgiff

If you want to help improve the situation, you should add the youtube video code as a production code to relevant TVDB episode page... Since I believe that database is open for user edits... Your changes to the database would benefit all users, not just yourself and if others did the same, it would greatly improve the compatibility...

itsgiff commented 1 year ago

how would I do that? I don't know how.

RandomNinjaAtk commented 1 year ago

You would visit the https://thetvdb.com/, register for an account. And then update the episodes on that site with the production code for the shows you want to be able to pull.

Just like in the links I posted earlier. Might be a good idea to write up a tutorial...

Jeor commented 1 year ago

There seems to be some inconsistencies with this.

This one has been edited to include the link to the video but does not download: https://thetvdb.com/series/captain-disillusion/episodes/9415186

This was successfully downloaded, however contains no link: https://thetvdb.com/series/captain-disillusion/episodes/8436947 image

Is there something else I'm missing?

RandomNinjaAtk commented 1 year ago

If the shows network is not listed as YouTube in sonarr, it will not bother to process it. I don't know if that is the case here but it's an assumption I'm making. Check both shows in sonarr to see if they have the same network.

What I'm talking about is at the series level, not episode. If they are both YouTube, you might need to provide some logs and steps to reproduce for it to be looked at further.

Edit:

I see both links are the same series, so you'll need to provide some logs of its attempt. Additionally, if your not using cookies for yt-dlp, your issue might be age restriction related. These are just some thoughts for possible issues/causes.

Jeor commented 1 year ago

The show is loaded as YouTube in sonarr. I’ll post some logs in a bit. I’ll definitely have to check out the cookies and age restricted content!

Jeor commented 1 year ago

Looks like it just took some time for the tvdb stuff to propagate? Still unsure as to how the worked unless it was edited to have the link removed after grabbing it?

For now seems like the easy way out is to just use ytdl to grab an entire channel formatted for sonarr (instead of listing all the links to every episode on tvdb).

RandomNinjaAtk commented 1 year ago

While it may be a good idea to just grab all of the channels content, however, there would be no verification the content is accurate and matches the db.

Because there is no standardization for how youtube content is managed, the idea is to remove the guess work... Which is not ideal because it takes some upfront legwork, but if everyone pitched in, it would be better overall..

RandomNinjaAtk commented 1 year ago

Looks like it just took some time for the tvdb stuff to propagate? Still unsure as to how the worked unless it was edited to have the link removed after grabbing it?

FYI: The script uses the production code, which is typically the youtube video ID, or the full url if available. Which is why that video will work because the production code is the youtube video id.

Example based on the link you provided: https://www.youtube.com/watch?v=tyixMpuGEL8