meeb / tubesync

Syncs YouTube channels and playlists to a locally hosted media server
GNU Affero General Public License v3.0
1.98k stars 129 forks source link

No Media to Index? #87

Closed storm-father closed 3 years ago

storm-father commented 3 years ago

I'm trying to pull some videos from my favorite poker vloggers and keep running into this error. I've tried multiple channels, set the resolution fallback to codec, changed audio type, tried the long channel id's and also their personalized ones.

I haven't tried playlists because none of them have those.

What should I try next?

Index media from source "Mariano Poker", attempted 4 times Error: "Source "Mariano Poker" (ID: 1380822e-2143-4e7f-9b7b-f3e5bff2109a) returned no media to index, is the source key valid? Check the source configuration is correct and that the source is reachable" Task will be retried at 2021-03-04 16:17:02

storm-father commented 3 years ago

I found a playlist and it fetched that just fine.

meeb commented 3 years ago

This is likely due to youtube-dl requiring an update. Please try :latest.

storm-father commented 3 years ago

This is likely due to youtube-dl requiring an update. Please try :latest.

I have it installed on unraid. No updates available.

TubeSync version 0.9 with youtube-dl version 2021.02.10 and FFmpeg version 4.3.1-static.

azerioxal commented 3 years ago

Unraid acts up with ghcr.io in my experience. If you're sure your template is running latest instead of the default v0.9, you should try going to advanced view on your docker tab and do a forced update.

storm-father commented 3 years ago

59BE1EBB-865D-40C1-A77C-06DA68B81D18

azerioxal commented 3 years ago

your template is still on v0.9, you need to change the tag to latest image

storm-father commented 3 years ago

Thanks, guys. Please excuse my ignorance 😆 Working like a charm now. Really appreciate it.

meeb commented 3 years ago

No-one should use the :latest really it has dev work in it, but TubeSync is still in alpha so that's where fixes are. This will get better over time. I'll push another release today at some point. I've also never used unraid so that's nothing directly related to this project really. When stable, TubeSync will have regular releases to update youtube-dl so I suspect pinned tags may not be the way forward in the end. In the interim though, you can use :latest or you can use the slightly more stable tagged releases and accept they might break for a day or two at a time during alpha development. Glad you got it working for you in the end!

meeb commented 3 years ago

Also just to clarify I didn't make any templates or anything for Unraid, so any issues there are not anything I've done :)

meeb commented 3 years ago

The new :0.9.1 release is a minor release but contains the same updated youtube-dl as :latest if you prefer to use tags for the moment. Either way, issue should be fixed so I'll close this for now. Feel free to create a new issue or re-open this one if your issue persists.

MatthK commented 3 years ago

I did have the same issue. Two channels suddenly stopped working and wouldn't get updated anymore, stating there is no media to index.

One channel is https://www.youtube.com/c/Blippi while the other one is https://www.youtube.com/c/mentourpilotaviation

I checked here and thought ok, I have to update to the latest version. I first updated to v0.9.1, yet after editing and saving the existing channels didn't get them working again. I added another channel, and that one was working just fine, so the actual download and indexing is working.

I then tried again and installed the :latest version to have the same issue remaining.

I then deleted one channel and created it new again, and voila, it just started working again. The other channel is still stuck.

Is there a way to reset this or do I have to delete/re-create the channel as the only option to get it working again?

meeb commented 3 years ago

Hi @MatthK, this sounds like a different issue with similar end symptoms. Can you check what's in your logs? It'll tell you what the actual error is not just the very last one you get in the dashboard.

$ docker logs tubesync

From a terminal and look for suitably important error messages.

MatthK commented 3 years ago

I tried, but there is nothing related to the failing of the sync. And although it says there are permanent errors, there is no error message showing at the bottom. I know I saw it previously, but probably due to the update, it doesn't show anymore?

Now, when I am in the source, it just says: This source has encountered permanent failures listed at the bottom of this page, check its settings. But there is no error message at the bottom.

I searched for "error" in the log file, and the only error I see is for some videos it couldn't download (on the channel that I recreated and is now updating). Also for "warn" didn't show any relevant hits. I restarted the container, and edited/saved the channel to hopefully trigger something in the log, but no sign there.

I don't mind re-creating the other channel too, but is there a way to avoid that it re-downloads all the videos again?

meeb commented 3 years ago

Ah, so currently if a source permanently fails it may just get marked as broken and not indexed again. Try the "reset tasks" button on the tasks page in the dashboard, and watch the docker logs tubesync while you do it. That will pretty much reset all the queued tasks including the indexing.

MatthK commented 3 years ago

Resetting the tasks did the trick. Thank you very much.

meeb commented 3 years ago

@MatthK for some background, the original logic of TubeSync just assumes that if some 20+ attempts to index all the videos on a channel fails that something is permanently broken (like someone put in the wrong channel name or some other never-fixable problem). This has turned out to be a bit over-zealous when you get 2-3 days of throttling by YouTube in some cases, indexing fails 20+ times and the channel gets permanently marked as broken when it really isn't. I plan on adding some sort of soft retry after X days feature to test permanently broken channels as a one-off to check to see if they really are broken or if it was just a very extended temporary problem, but in the interim the reset tasks button will just force-clear all the errors and make TubeSync retry everything from scratch.