openzim / mindtouch

libretexts.org to ZIM scraper
GNU General Public License v3.0
0 stars 0 forks source link

Pass proper user-agent #79

Open benoit74 opened 3 days ago

benoit74 commented 3 days ago

Just like https://github.com/openzim/nautilus/issues/101, and probably to please also a bit other websites, we should pass a custom User-Agent header in all our web requests.