search

tosdr / crawler.tosdr.org

ToS;DR Crawlers
11 stars 2 forks source link

Support HTTP/2 #5

Open JustinBack opened 1 year ago

JustinBack commented 1 year ago

The crawler supports only HTTP/1.1 right now, which breaks compability with sites that require HTTP/2 or higher.

https://tosdr.atlassian.net/browse/TDC-7

Deveroonie commented 1 year ago

that is a good idea as some services are starting to drop http/1.1 support