Add support for Apache directory listings

ytdl-org / youtube-dl

Command-line program to download videos from YouTube.com and other video sites

http://ytdl-org.github.io/youtube-dl/

The Unlicense

132.36k stars 10.04k forks source link

Add support for Apache directory listings #10886

Open weedy opened 8 years ago

weedy commented 8 years ago

I have a project where youtube-dl's --download-archive would be really handy.

Can you add a processor for just web server (apache) directory lists? I have a few large directories filled with mp4s and --download-archive would make my life a lot easier.

yan12125 commented 8 years ago

I limit to Apache only as I guess different servers have different layouts.

weedy commented 8 years ago

Based off a quick Google. Nginx at least has a very similar looking listing. If you're just walking the DOM with beautiful soup or whatever and pulling out 'a href=' pointing to files it should work for more then just Apache. Probably.