search

openzim / openedx

Open edX (to zim) scraper
GNU General Public License v3.0
8 stars 7 forks source link

Missing videos #159

Closed Popolechien closed 4 years ago

Popolechien commented 4 years ago

Looks very much like #145 except that in this case it's for all three PHZH zims. Capture d’écran 2020-10-21 à 17 03 05

satyamtg commented 4 years ago

This is not quite related to #145. I tested the download and encode process again. They work fine. It's because youtube_dl is throwing 429s. I checked all the logs, and all have the same thing. Launched https://farm.openzim.org/pipeline/5f9269226c97ec4f8563ed54 to see what's the current scenario.

Maybe we can also launch a youtube recipe after this to see if other scrapers are affected

kelson42 commented 4 years ago

Could we at least secure the openedx scraper fails properly if impossible to retrieve any video?

rgaudin commented 4 years ago
Screen Shot 2020-10-23 at 09 31 18

videos works in this run but still that blank space above it