internetarchive / brozzler

brozzler - distributed browser-based web crawler
Apache License 2.0
669 stars 97 forks source link

brozzler-worker hangs when --skip-youtube-dl option is used #161

Open danielbicho opened 5 years ago

danielbicho commented 5 years ago

When trying to capture this page https://jornadas.fccn.pt/agenda/, brozzler hangs trying to crawl the resources in the bottom (ex: https://jornadas.fccn.pt/wp-content/uploads/2019/08/NAU_Rui_Ribeiro_8min.pptx).

The behavior occurs only with --skip-youtube-dl option!