add accept header on retry

urlstechie / urlchecker-python

:snake: :link: Python module and client for checking URLs

https://urlchecker-python.readthedocs.io

MIT License

20 stars 12 forks source link

Closed vsoch closed 2 years ago

vsoch commented 2 years ago

SuperKogito commented 2 years ago

Screenshot from 2022-06-30 01-45-05

As you can see, it only works for DOI. If you have time you should maybe test if this is related to the Agents? could it be that some agents work well with these links and some not ?
Also, can you please add some DOI (and maybe some sciencedirect) links to our dummy links files, that way they will be included in future tests.

vsoch commented 2 years ago

Superceded by #76