quyin
commented
10 years ago the char '*' is not URL safe. it can be the underlying library complaining about invalid URLs (which are used widely on today's web, though).
will follow with this and get it under test. things to do:
- improve error reporting / logging. in this case it should log the exception.
- a test case for this.
- escaping unsafe characters when extracting / forming the URL. probably better to do this in ParsedURL.
Best Regards, Yin Qu (屈垠)
On Fri, Jan 31, 2014 at 12:29 PM, Kade Keith notifications@github.comwrote:
I am working in the assistapp environment.
additionally, once a timeout has occurred, no more pages (not even cached ones) will load and display.
the error message: WARNING - DocumentClosure[ http://www.metmuseum.org/Collections/search-the-collections/622935?rpp=20&pg=1&rndkey=20140131&ao=on&ft=*&where=France&pos=5]:Error opening connection for http://www.metmuseum.org/Collections/search-the-collections/622935?rpp=20&pg=1&rndkey=20140131&ao=on&ft=*&where=France&pos=5
I used curl to see if the site was somehow throttling access after a certain number of page loads and that didn't seem to be the problem
— Reply to this email directly or view it on GitHubhttps://github.com/ecologylab/BigSemanticsWrapperRepository/issues/15 .
keithkade
I am working in the assistapp environment.
additionally, once a timeout has occurred, no more pages (not even cached ones) will load and display.
the error message: WARNING - DocumentClosure[http://www.metmuseum.org/Collections/search-the-collections/622935?rpp=20&pg=1&rndkey=20140131&ao=on&ft=*&where=France&pos=5]: Error opening connection for http://www.metmuseum.org/Collections/search-the-collections/622935?rpp=20&pg=1&rndkey=20140131&ao=on&ft=*&where=France&pos=5
I used curl to see if the site was somehow throttling access after a certain number of page loads and that didn't seem to be the problem