search

weecology / ogrants

Open grants list
https://www.ogrants.org/
Other
125 stars 46 forks source link

Touch up infrastructure including tests and docs #107

Closed dhimmel closed 4 years ago

dhimmel commented 4 years ago

https://eprints.qut.edu.au/98764/ is returning HTTP Error 403: Forbidden for the machine user:

import urllib.request
url = 'https://eprints.qut.edu.au/98764/'
response = urllib.request.urlopen(url)

seems to work with curl... maybe have to set some headers?

ethanwhite commented 4 years ago

Thanks @dhimmel!

Yeah, that link has been difficult since it was added. Attempts to get it passing definitely welcome.

dhimmel commented 4 years ago

Yeah, that link has been difficult since it was added. Attempts to get it passing definitely welcome.

I've played around a bit more with that link and still don't understand why it fails. Also found that it failed with curl/7.58.0 on Google Collab's system, but passed locally with curl/7.64.1.

I'm thinking the best solution would be to add a whitelist of URLs, that for now would just include https://eprints.qut.edu.au/98764/. In the future, other URLs that misbehave can be added. These URLs would have to be manually checked to see if they are broken, but at least won't cause CI to fail.

I will also email askqut@qut.edu.au to alert them of the issue.