search

pnoll1 / osmand_map_creation

OSM data + open address data compiled for use in OSMAnd
GNU General Public License v3.0
74 stars 2 forks source link

investigate au hang #56

Open pnoll1 opened 1 year ago

pnoll1 commented 1 year ago

last month it took 10 minutes to write au countrywide, this month writing looks hung with no visible progress for 22 hours+

pnoll1 commented 1 year ago

rerunning with smaller slices worked. Seems like another issue with bad behavior with high memory usage. Need to keep slices resonable or add memory.

pnoll1 commented 1 year ago

another hang with au countrywide.

pnoll1 commented 1 year ago

Looks like FR countrywide has joined the party, hung for 8 hours and counting

pnoll1 commented 1 year ago

Process gets killed by OOM.


2023-04-29T18:04:48.448175-07:00 desktop kernel: [2235266.766257] Out of memory: Killed process 2443622 (python3) total-vm:62448756kB, anon-rss:57281632kB, file-rss:0kB, shmem-rss:4kB, UID:232072 pgtables:122044kB oom_score_adj:0
2023-04-29T18:04:50.477971-07:00 desktop kernel: [2235268.852299] oom_reaper: reaped process 2443622 (python3), now anon-rss:0kB, file-rss:0kB, shmem-rss:4kB

htop had it at 56 res, not sure if that counts swap because that could be another 8GB. Could try increasing swap

pnoll1 commented 1 year ago

There should be sufficient memory after upgrade to 64GB months ago. Last time was due to issue described in #75. There were double the amount of addresses there should be since hash wasn't a stable id across runs.

pnoll1 commented 5 months ago

This is caused by OOM killer