search

bdon / TileSiege

Realistic load testing for tile servers
BSD 2-Clause "Simplified" License
30 stars 2 forks source link

Alternative idea #5

Open hyperknot opened 1 month ago

hyperknot commented 1 month ago

Hi Brandon,

Nice script, you used siege, I used wrk + a lua script for this: https://github.com/hyperknot/openfreemap/tree/main/modules/http_host/benchmark

Here are my results for it: https://github.com/hyperknot/openfreemap/blob/main/docs/quick_notes/http_benchmark.md

bdon commented 1 month ago

Is access.jsonl https://github.com/hyperknot/openfreemap/blob/main/modules/http_host/benchmark/create_path_list.py#L4 available for download?

The TileSiege testing uses OSM logs https://github.com/bdon/TileSiege/blob/master/top100k_90days.py which are aggregated by tile ID to anonymize the users. This means the traffic isn't perfectly realistic because of no spatial correlation like panning or zooming. It would be nice to have a privacy-preserving access log to benchmark with instead.

I would like to adopt wrk since siege feels a bit outdated.

hyperknot commented 1 month ago

That is an actual log from my server, but I don't want to make it public to preserve users' privacy. Maybe on a popular instance we could get this log, it'd be highly random, but I don't have an instance with random enough access pattern.