let4be / crusty

Broad Web Crawler
GNU General Public License v3.0
83 stars 3 forks source link

Review how we access DNS resolved addresses #36

Closed let4be closed 2 years ago

let4be commented 3 years ago

Right now we do not precisely control which address hyper will use when connecting but we assume it's the first one(and concurrency restrictions being applied accordingly, which may backfire)

let4be commented 3 years ago

https://github.com/let4be/crusty/issues/10 Is related