get_articles.get_url_content() never appears to be able to get URL contents. I performed the following experiment. In get_articles.py, I added the lines
content = get_url_content(url_path, url)
if len(content) > 0:
pass
and set a breakpoint at pass. The code never entered the line 'pass' after searching > 100 articles. This doesn't seem right.
get_articles.get_url_content()
never appears to be able to get URL contents. I performed the following experiment. In get_articles.py, I added the linesand set a breakpoint at pass. The code never entered the line 'pass' after searching > 100 articles. This doesn't seem right.