Collect statistics about crawled entries

dpovshed / octopus

Sitemap checker/stress test tool based on ReactPHP

11 stars 1 forks source link

Collect statistics about crawled entries #19

Open holtkamp opened 6 years ago

holtkamp commented 6 years ago

It might be interesting to collect information during crawling, something I would like to know:

response time
- maximum
- minimum
- average / 95 percentile
size of response body
- maximum
- minimum
- average / 95 percentile

dpovshed commented 6 years ago

Probably it might be interesting! At the same time - there is a classic tool apache bench, ab. If we go to extend Octopus into that direction, we could look at the metrics more carefully.