spider-rs / spider

A web crawler and scraper for Rust
https://spider.cloud
MIT License
1.16k stars 101 forks source link

Access to reqwest internal structures ? #226

Open rgrunbla opened 1 week ago

rgrunbla commented 1 week ago

Hi,

Is it possible to have access to reqwest internal structures, e.g. Response, during a crawl / scrape made by spider ? My main use case would be having access to remote_addr, but I expect having such an access could be interesting for more fields.

Thanks !