adds get_path_and_netloc_to_send() to calculate the netloc and the path on server to be passed in next recursion in html_processor.py properly
add scheme in prepare_url() if not present already as its absence sometimes makes urllib.parse.urlparse() not correctly parse the URL resulting in messed up paths
send correct path and netloc to download_dependencies_from_css() from download_css_from_html()
process iframes only if content could be fetched from URL
This does the following -
get_path_and_netloc_to_send()to calculate the netloc and the path on server to be passed in next recursion in html_processor.py properlyprepare_url()if not present already as its absence sometimes makesurllib.parse.urlparse()not correctly parse the URL resulting in messed up pathsdownload_dependencies_from_css()fromdownload_css_from_html()