aitjcize / cppman

C++ 98/11/14 manual pages for Linux/MacOS
GNU General Public License v3.0
1.27k stars 79 forks source link

Add custom headers to requests #149

Closed glenvt18 closed 1 year ago

glenvt18 commented 1 year ago

Looks like cppreference is blocking urllib requests now. This PR fixes it. To test run

PYTHONPATH=. python3 cppman/formatter/cppreference.py

After adding custom headers indexing works much faster. Maybe we should consider slowing it down to put less stress on the sites.

BoManev commented 1 year ago

PR fixes #150