search

Project-OSRM / osrm-backend

Open Source Routing Machine - C++ backend
http://map.project-osrm.org
BSD 2-Clause "Simplified" License
6.42k stars 3.4k forks source link

Fix Windows CI: update conan.cmake and disable unit tests as temporary workaround for OOM issues #6930

Closed SiarheiFedartsou closed 5 months ago

SiarheiFedartsou commented 5 months ago

It seems compiler on Windows CI image was silently updated... https://github.com/Project-OSRM/osrm-backend/actions/runs/9406402190/job/25909804011

Screenshot 2024-06-06 at 21 23 55

Benchmark Results

 | Benchmark | Base | PR | |-----------|------|----| | alias | aliased u32: 1171.92
plain u32: 1152.72
aliased double: 1211.81
plain double: 1188.42 | aliased u32: 1154.91
plain u32: 1156.47
aliased double: 1188.07
plain double: 1193.56 | | e2e_match_ch | Total: 2948.2903480529785ms
Min time: 2.417325973510742ms
Mean time: 22.50603319124411ms
Median time: 17.604351043701172ms
95th percentile: 71.58946990966797ms
99th percentile: 85.05244255065912ms
Max time: 96.44842147827148ms | Total: 2916.4178371429443ms
Min time: 2.3775100708007812ms
Mean time: 22.262731581243848ms
Median time: 17.18449592590332ms
95th percentile: 71.29311561584473ms
99th percentile: 85.56318283081053ms
Max time: 94.80023384094238ms | | e2e_match_mld | Total: 2062.250852584839ms
Min time: 2.0775794982910156ms
Mean time: 15.742372920494953ms
Median time: 9.059667587280273ms
95th percentile: 49.502015113830566ms
99th percentile: 58.540248870849574ms
Max time: 67.98863410949707ms | Total: 2066.682815551758ms
Min time: 2.096414566040039ms
Mean time: 15.77620469886838ms
Median time: 9.074687957763672ms
95th percentile: 50.968289375305176ms
99th percentile: 57.54888057708737ms
Max time: 66.68734550476074ms | | e2e_nearest_ch | Total: 1366.6179180145264ms
Min time: 1.1627674102783203ms
Mean time: 1.3666179180145264ms
Median time: 1.2807846069335938ms
95th percentile: 1.7758727073669431ms
99th percentile: 1.8318533897399902ms
Max time: 1.9807815551757812ms | Total: 1372.6558685302734ms
Min time: 1.1446475982666016ms
Mean time: 1.3726558685302734ms
Median time: 1.2854337692260742ms
95th percentile: 1.7901062965393066ms
99th percentile: 1.8684935569763184ms
Max time: 1.9676685333251953ms | | e2e_nearest_mld | Total: 1355.2865982055664ms
Min time: 1.127004623413086ms
Mean time: 1.3552865982055664ms
Median time: 1.2688636779785156ms
95th percentile: 1.7658352851867676ms
99th percentile: 1.830909252166748ms
Max time: 1.9135475158691406ms | Total: 1359.4236373901367ms
Min time: 1.150369644165039ms
Mean time: 1.3594236373901367ms
Median time: 1.2729167938232422ms
95th percentile: 1.7855644226074219ms
99th percentile: 1.8423247337341309ms
Max time: 1.9216537475585938ms | | e2e_route_ch | Total: 3323.6308097839355ms
Min time: 1.397848129272461ms
Mean time: 3.3236308097839355ms
Median time: 3.3500194549560547ms
95th percentile: 4.373478889465332ms
99th percentile: 4.873156547546387ms
Max time: 5.348682403564453ms | Total: 3353.3589839935303ms
Min time: 1.4307498931884766ms
Mean time: 3.3533589839935303ms
Median time: 3.3876895904541016ms
95th percentile: 4.377889633178711ms
99th percentile: 4.870200157165527ms
Max time: 5.796194076538086ms | | e2e_route_mld | Total: 3840.7769203186035ms
Min time: 1.3613700866699219ms
Mean time: 3.8407769203186035ms
Median time: 3.8878917694091797ms
95th percentile: 5.317449569702148ms
99th percentile: 5.764913558959961ms
Max time: 6.606817245483398ms | Total: 3784.6667766571045ms
Min time: 1.3654232025146484ms
Mean time: 3.7846667766571045ms
Median time: 3.8149356842041016ms
95th percentile: 5.2040815353393555ms
99th percentile: 5.77890157699585ms
Max time: 6.380796432495117ms | | e2e_table_ch | Total: 16445.453882217407ms
Min time: 2.1889209747314453ms
Mean time: 16.445453882217407ms
Median time: 15.662312507629395ms
95th percentile: 30.093610286712643ms
99th percentile: 31.243255138397217ms
Max time: 33.2028865814209ms | Total: 16855.68904876709ms
Min time: 2.2029876708984375ms
Mean time: 16.85568904876709ms
Median time: 16.205191612243652ms
95th percentile: 30.828988552093506ms
99th percentile: 32.6899528503418ms
Max time: 36.53883934020996ms | | e2e_table_mld | Total: 64992.84219741821ms
Min time: 4.218816757202148ms
Mean time: 64.99284219741821ms
Median time: 61.6685152053833ms
95th percentile: 125.92855691909789ms
99th percentile: 135.02317190170288ms
Max time: 143.13697814941406ms | Total: 64967.54264831543ms
Min time: 4.517078399658203ms
Mean time: 64.96754264831543ms
Median time: 61.45322322845459ms
95th percentile: 125.55983066558838ms
99th percentile: 134.70858097076416ms
Max time: 143.4025764465332ms | | e2e_trip_ch | Total: 11385.282278060913ms
Min time: 1.8186569213867188ms
Mean time: 11.385282278060913ms
Median time: 10.976433753967285ms
95th percentile: 19.488930702209473ms
99th percentile: 21.25053882598877ms
Max time: 22.016525268554688ms | Total: 11690.971612930298ms
Min time: 1.5816688537597656ms
Mean time: 11.690971612930298ms
Median time: 11.211037635803223ms
95th percentile: 20.035159587860107ms
99th percentile: 21.71929359436035ms
Max time: 23.308277130126953ms | | e2e_trip_mld | Total: 18514.16826248169ms
Min time: 1.7778873443603516ms
Mean time: 18.51416826248169ms
Median time: 18.216729164123535ms
95th percentile: 29.77352142333984ms
99th percentile: 31.47693157196045ms
Max time: 33.908843994140625ms | Total: 18379.89902496338ms
Min time: 1.7948150634765625ms
Mean time: 18.37989902496338ms
Median time: 18.059372901916504ms
95th percentile: 29.63191270828247ms
99th percentile: 31.572368144989014ms
Max time: 32.866477966308594ms | | json-render | String: 6.59646ms
Stringstream: 9.30226ms
Vector: 6.9316ms | String: 6.65803ms
Stringstream: 9.36392ms
Vector: 6.98215ms | | match_ch | Default radius:
4.42566ms/req at 82 coordinate
0.0539714ms/coordinate
Radius 5m:
4.40111ms/req at 82 coordinate
0.0536721ms/coordinate
Radius 10m:
15.0884ms/req at 82 coordinate
0.184005ms/coordinate
Radius 15m:
36.8243ms/req at 82 coordinate
0.449076ms/coordinate
Radius 30m:
313.188ms/req at 82 coordinate
3.81936ms/coordinate | Default radius:
4.41137ms/req at 82 coordinate
0.0537972ms/coordinate
Radius 5m:
4.4017ms/req at 82 coordinate
0.0536793ms/coordinate
Radius 10m:
15.0794ms/req at 82 coordinate
0.183895ms/coordinate
Radius 15m:
36.8351ms/req at 82 coordinate
0.449209ms/coordinate
Radius 30m:
312.972ms/req at 82 coordinate
3.81673ms/coordinate | | match_mld | Default radius:
2.77654ms/req at 82 coordinate
0.0338603ms/coordinate
Radius 5m:
2.80799ms/req at 82 coordinate
0.0342438ms/coordinate
Radius 10m:
10.1642ms/req at 82 coordinate
0.123954ms/coordinate
Radius 15m:
25.8945ms/req at 82 coordinate
0.315787ms/coordinate
Radius 30m:
303.979ms/req at 82 coordinate
3.70706ms/coordinate | Default radius:
2.96465ms/req at 82 coordinate
0.0361542ms/coordinate
Radius 5m:
2.94964ms/req at 82 coordinate
0.0359712ms/coordinate
Radius 10m:
11.133ms/req at 82 coordinate
0.135768ms/coordinate
Radius 15m:
28.6986ms/req at 82 coordinate
0.349983ms/coordinate
Radius 30m:
303.662ms/req at 82 coordinate
3.7032ms/coordinate | | osrm_contract | Time: 95.52s Peak RAM: 185.42MB | Time: 94.40s Peak RAM: 185.63MB | | osrm_customize | Time: 1.30s Peak RAM: 115.07MB | Time: 1.32s Peak RAM: 115.06MB | | osrm_extract | Time: 12.23s Peak RAM: 414.71MB | Time: 12.47s Peak RAM: 403.03MB | | osrm_partition | Time: 2.21s Peak RAM: 148.62MB | Time: 2.31s Peak RAM: 149.68MB | | packedvector | random write:
std::vector 11187 ms
util::packed_vector 74374.5 ms
slowdown: 6.64832
random read:
std::vector 8648.69 ms
util::packed_vector 30331.3 ms
slowdown: 3.50704 | random write:
std::vector 11279.9 ms
util::packed_vector 74629.1 ms
slowdown: 6.61611
random read:
std::vector 11091.5 ms
util::packed_vector 31013.6 ms
slowdown: 2.79617 | | route_ch | 1000 routes, 3 coordinates, no alternatives, overview=full, steps=true
509.746ms
0.509746ms/req
1000 routes, 2 coordinates, no alternatives, overview=full, steps=true
350.473ms
0.350473ms/req
1000 routes, 2 coordinates, 3 alternatives, overview=full, steps=true
626.126ms
0.626126ms/req
1000 routes, 3 coordinates, no alternatives, overview=false, steps=false
153.48ms
0.15348ms/req
1000 routes, 2 coordinates, no alternatives, overview=false, steps=false
97.5078ms
0.0975078ms/req
1000 routes, 2 coordinates, 3 alternatives, overview=false, steps=false
132.669ms
0.132669ms/req
1000 routes, 3 coordinates, no alternatives, overview=false, steps=false, radius=750
150.212ms
0.150212ms/req
1000 routes, 2 coordinates, no alternatives, overview=false, steps=false, radius=750
97.3822ms
0.0973822ms/req
1000 routes, 2 coordinates, 3 alternatives, overview=false, steps=false, radius=750
131.921ms
0.131921ms/req | 1000 routes, 3 coordinates, no alternatives, overview=full, steps=true
511.715ms
0.511715ms/req
1000 routes, 2 coordinates, no alternatives, overview=full, steps=true
352.969ms
0.352969ms/req
1000 routes, 2 coordinates, 3 alternatives, overview=full, steps=true
626.764ms
0.626764ms/req
1000 routes, 3 coordinates, no alternatives, overview=false, steps=false
151.548ms
0.151548ms/req
1000 routes, 2 coordinates, no alternatives, overview=false, steps=false
97.7536ms
0.0977536ms/req
1000 routes, 2 coordinates, 3 alternatives, overview=false, steps=false
132.259ms
0.132259ms/req
1000 routes, 3 coordinates, no alternatives, overview=false, steps=false, radius=750
151.151ms
0.151151ms/req
1000 routes, 2 coordinates, no alternatives, overview=false, steps=false, radius=750
97.5273ms
0.0975273ms/req
1000 routes, 2 coordinates, 3 alternatives, overview=false, steps=false, radius=750
132.379ms
0.132379ms/req | | route_mld | 1000 routes, 3 coordinates, no alternatives, overview=full, steps=true
639.283ms
0.639283ms/req
1000 routes, 2 coordinates, no alternatives, overview=full, steps=true
436.25ms
0.43625ms/req
1000 routes, 2 coordinates, 3 alternatives, overview=full, steps=true
812.211ms
0.812211ms/req
1000 routes, 3 coordinates, no alternatives, overview=false, steps=false
261.041ms
0.261041ms/req
1000 routes, 2 coordinates, no alternatives, overview=false, steps=false
159.992ms
0.159992ms/req
1000 routes, 2 coordinates, 3 alternatives, overview=false, steps=false
284.667ms
0.284667ms/req
1000 routes, 3 coordinates, no alternatives, overview=false, steps=false, radius=750
257.605ms
0.257605ms/req
1000 routes, 2 coordinates, no alternatives, overview=false, steps=false, radius=750
158.876ms
0.158876ms/req
1000 routes, 2 coordinates, 3 alternatives, overview=false, steps=false, radius=750
283.532ms
0.283532ms/req | 1000 routes, 3 coordinates, no alternatives, overview=full, steps=true
638.32ms
0.63832ms/req
1000 routes, 2 coordinates, no alternatives, overview=full, steps=true
435.18ms
0.43518ms/req
1000 routes, 2 coordinates, 3 alternatives, overview=full, steps=true
806.769ms
0.806769ms/req
1000 routes, 3 coordinates, no alternatives, overview=false, steps=false
260.83ms
0.26083ms/req
1000 routes, 2 coordinates, no alternatives, overview=false, steps=false
160.76ms
0.16076ms/req
1000 routes, 2 coordinates, 3 alternatives, overview=false, steps=false
281.477ms
0.281477ms/req
1000 routes, 3 coordinates, no alternatives, overview=false, steps=false, radius=750
257.202ms
0.257202ms/req
1000 routes, 2 coordinates, no alternatives, overview=false, steps=false, radius=750
159.85ms
0.15985ms/req
1000 routes, 2 coordinates, 3 alternatives, overview=false, steps=false, radius=750
281.405ms
0.281405ms/req | | rtree | 1 result:
207.869ms -> 0.0207869 ms/query
10 results:
242.434ms -> 0.0242434 ms/query | 1 result:
208.745ms -> 0.0208745 ms/query
10 results:
244.486ms -> 0.0244486 ms/query |
SiarheiFedartsou commented 5 months ago

I decided to merge only fix of Conan-related things. Another issue is that now we have OOM when building tests, so I disabled tests for the time being and created ticket for that... https://github.com/Project-OSRM/osrm-backend/issues/6935