Perf: refactor spatial - Githubissues

mitra42 commented 4 years ago

Result of conversation with @danaronson just now ... in essence.

Refactor spatial dict - replace the rtree with a simple spatial bucketing in a dict
Bucket size matches the prefix size used -currently 2.
I suggest we do 4 level: Integer of Lat; Integer of Long; 2DP lat; 2DP long
Bounding boxes split into these 2DP size hunks when requested, and iterate over them (we already iterate over an array of Bboxes)
no changes to protocol
need to handle wrapping at 180, but can do that when splitting bboxes

mitra42 commented 4 years ago

[x] split bounding boxes on receipt in _scan_or_sync, so array covers them all
[x] build new data structure holding buckets
[x] edit access functions so look same as current ones (will list them here)
[x] For now store in both rtree and buckets
[ ] Make sure to delete from both
[x] go back and find TODO-166.
[x] new data type (not a class) made of ints instead of floats or strings - call it bbox and bboxs

mitra42 commented 4 years ago

Overall - this brings time for 70x70 to 268s but only 98 in render which is 10ms per.

mitra42 commented 4 years ago

Was merged yesterday

Safe2COVIDApp / bct-server