search

openzim / youtube

Create a ZIM file from a Youtube channel/username/playlist
GNU General Public License v3.0
43 stars 26 forks source link

Unable to scrape long videos #153

Closed Popolechien closed 1 year ago

Popolechien commented 2 years ago

Probably following up on openzim/zimfarm#722 : I have been trying to scrape a movie off youtube (recipe here) to no avail for the past two weeks. The workers get blacklisted after a few hours of work (target movies were about 90 minutes long)

rgaudin commented 2 years ago

Not related to openzim/zimfarm#722. That ticket is about API request which has nothing to do with this.

Then is nothing we can do at the scraper level about this. Trying to run it on a worker which haven't done any youtube in a little while and making sure it's the single youtube recipe (using the platform limitation) would increase the chances of it passing.

Popolechien commented 2 years ago

Waiting for PR to be merged on youtube-dl

stale[bot] commented 2 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be now be reviewed manually. Thank you for your contributions.

kelson42 commented 1 year ago

@rgaudin Considering that we don't use youtube-dl anymore, what is the status of this ticket?

rgaudin commented 1 year ago

Looks like @Popolechien reopened this ticket because I fixed it with the hidden patch and he was expecting us to close this upon upstream merge?? Or maybe it was just an accident :)

Anyway, we don't use it anymore and this issue is obsolete.