search

kieraneglin / pinchflat

Your next YouTube media manager
GNU Affero General Public License v3.0
832 stars 16 forks source link

[Triage] Not downloading new media after the initial scrape #205

Closed dhruvbhutani closed 4 months ago

dhruvbhutani commented 4 months ago

Hi,

As the title suggests, I'm unable to download any media after the initial scrape. Additionally, I have a hundred or so tasks listed under pending.

I've set the indexing to daily so that shouldn't be an issue. Can I get some help on what I might be doing wrong and if there's a was to share logs?

kieraneglin commented 4 months ago

Hey there, thanks for the report!

There's a few reasons this could happen:

Can you confirm whether some videos have been downloaded since you posted this issue? The logs are stored in your Pinchflat config directory

dhruvbhutani commented 4 months ago

Nah. The last download was four days ago.

Source 1 has a hundred or so videos pending. Source 2 has no pending videos. However, the channel has added new videos, but Pinchflat hasn't picked them up yet.

Both sources are set to download. I've also tried forcing a download, which didn't do anything.

[image: ltp|1714409524631236]

On Mon, Apr 29, 2024 at 10:20 PM Kieran @.***> wrote:

Hey there, thanks for the report!

There's a few reasons this could happen:

Can you confirm whether some videos have been downloaded since you posted this issue?

— Reply to this email directly, view it on GitHub https://github.com/kieraneglin/pinchflat/issues/205#issuecomment-2083208929, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAHDF77SICOIPLAJV2RXDTDY7Z25BAVCNFSM6AAAAABG5UQSL6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAOBTGIYDQOJSHE . You are receiving this because you authored the thread.Message ID: @.***>

kieraneglin commented 4 months ago

In that case I'll need to know some more information. Would you mind attaching your logs?

dhruvbhutani commented 4 months ago

I don't mind doing that at all. But you'll have to guide me on where to grab the log files from.

[image: ltp|17144107603354151]

On Mon, Apr 29, 2024 at 10:42 PM Kieran @.***> wrote:

In that case I'll need to know some more information. Would you mind attaching your logs?

— Reply to this email directly, view it on GitHub https://github.com/kieraneglin/pinchflat/issues/205#issuecomment-2083245121, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAHDF7YLP2G4JKOIUTPY4W3Y7Z5PNAVCNFSM6AAAAABG5UQSL6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAOBTGI2DKMJSGE . You are receiving this because you authored the thread.Message ID: @.***>

kieraneglin commented 4 months ago

No problem! As I said above, the logs are stored in your Pinchflat config directory (within a sub-directory called logs)

dhruvbhutani commented 4 months ago

Here you go.

[image: ltp|17144112053701240]

On Mon, Apr 29, 2024 at 10:49 PM Kieran @.***> wrote:

No problem! As I said above, the logs are stored in your Pinchflat config directory (within a sub-directory called logs)

— Reply to this email directly, view it on GitHub https://github.com/kieraneglin/pinchflat/issues/205#issuecomment-2083256544, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAHDF77JDJIPQD4RKITBJGDY7Z6J3AVCNFSM6AAAAABG5UQSL6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAOBTGI2TMNJUGQ . You are receiving this because you authored the thread.Message ID: @.***>

kieraneglin commented 4 months ago

Hmm, it looks like the file didn't get attached. I think you have to upload it to the issue directly rather than adding it as an email attachment (which also explains the [image: ltp|17144107603354151] messages from earlier in the thread)

dhruvbhutani commented 4 months ago

pinchflat.log Done. This should work hopefully.

kieraneglin commented 4 months ago

That's a weird one! It definitely appears to be something to do with the BBC restricting viewership. Here are some examples of videos present on that playlist but they cannot be played:

All of these (and dozens more) are in the logs as having failed to download. Note that you may not be able to see these videos in the YouTube UI, but that's just because YT hides videos you can't view. yt-dlp can still see them just fine

But when I look at this playlist, it seems to have downloaded as expected since it doesn't have any restrictions on viewership.

I'm not sure how to approach this. I think what the app is doing is expected since that is, indeed, pending media that should be downloaded if it is ever able. I'll make some improvements to the download worker but I think for the moment I'm leaning toward the app working as expected in this weird case

dhruvbhutani commented 4 months ago

Interesting. Thanks for looking into it. I'll keep an eye out in case this comes up again. Incredible app btw. Thanks for the effort.

[image: ltp|171441879350180]

On Tue, Apr 30, 2024 at 12:54 AM Kieran @.***> wrote:

That's a weird one! It definitely appears to be something to do with the BBC restricting viewership. Here are some examples of videos present on that playlist https://www.youtube.com/playlist?list=PL1XPWZmYWdc32Z5g3YoKJw4I8BC01c3fr but they cannot be played:

All of these (and dozens more) are in the logs as having failed to download.

But when I look at this playlist @.***>, it seems to have downloaded as expected since it doesn't have any restrictions on viewership.

I'm not sure how to approach this. I think what the app is doing is expected since that is, indeed, pending media that should be downloaded if it is ever able. I'll make some improvements to the download worker but I think for the moment I'm leaning toward the app working as expected in this weird case

— Reply to this email directly, view it on GitHub https://github.com/kieraneglin/pinchflat/issues/205#issuecomment-2083496948, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAHDF762THKPBJ3Y5YZVQLDY72NARAVCNFSM6AAAAABG5UQSL6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAOBTGQ4TMOJUHA . You are receiving this because you authored the thread.Message ID: @.***>

jl94x4 commented 4 months ago

Having this issue aswel.