search

raviqqe / muffet

Fast website link checker in Go
MIT License
2.49k stars 96 forks source link

unsplash.com returns 405 #288

Closed xoxys closed 1 year ago

xoxys commented 1 year ago

A few days ago, checking unsplash.com URLs has stopped working and returns HTTP 405 now. Checking the sites with curl still seems to be working, any idea why this happens with muffet?

http://127.0.0.1:8000/posts/2020/07/create-a-static-site-hosting-platform/
    405 https://unsplash.com/@altumcode
    405 https://unsplash.com/s/photos/coding
raviqqe commented 1 year ago

Can you try masquerading a user-agent header like --header 'user-agent: curl'?

xoxys commented 1 year ago

Thanks. Yes, that seems to work.