search

dzfranklin / plantopo

https://plantopo.com
GNU Affero General Public License v3.0
0 stars 0 forks source link

debug why at sample import failed #195

Closed dzfranklin closed 1 month ago

dzfranklin commented 10 months ago

it spiked CPU & memory to 100% and the server fell over.

this has to be a bug, the file isn't that big

dzfranklin commented 10 months ago

right after I rebooted the server at least half the CPU was being spent by logzio-trivy.

maybe the problem was the excessive logging I have in the converter?

dzfranklin commented 10 months ago

in my defense this also crashes the caltopo app

dzfranklin commented 10 months ago

I tried importing a ptinternal file. Server resources stayed normal, grpc failed with message too big. The giant file is about twice the max. Probably should implement splitting the initial load changeset into multiple (would be useful for log store also).

I can serialize individual sets into rawjson