Closed satyamtg closed 4 years ago
I disagree with the removal of youtube-dl update. This will lead to issues in the future. Also, checked the zimfarm and we want to keep single thread for youtube (will update scraperlib as well). Finally, we're missing a changelog entry
Did those changes.
This allows parallel downloading of the different xblock contents and hence reduces the offlining time. Though the downloads done inside the xblocks are not parallelized, this should anyways give a performance boost as there are a large number of xblocks in any course.
The following changes are made -
download()
method override of the block extractor objects which ran download() of its descendants has been removedentrypoint.sh
has been removedYoutubeDownloader
is used to download youtube videosdownload()
method calling is parallelized