specify a dummy user agent

erikriver / opengraph

A python module to parse the Open Graph Protocol

http://ogp.me/

MIT License

226 stars 82 forks source link

specify a dummy user agent #35

Closed radfaz closed 6 years ago

radfaz commented 6 years ago

Some websites block access from scripts to avoid 'unnecessary' usage of their servers by reading the headers urllib sends and thus results in 403 error when fetching data. this PR adds a dummy one